00000001:02000400:0.0F:1787787129.797826:0:2965:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1787787142.776996:0:3168:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing load_modules_local 00000001:01000000:1.0:1787787144.276734:0:3231:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 583 MB/s 00000001:01000000:3.0F:1787787144.526555:0:3231:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 879 MB/s 00000001:01000000:1.0:1787787144.776920:0:3231:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4075 MB/s 00000020:02000000:3.0:1787787145.443045:0:3260:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_52_gc224de1 00000400:02000000:0.0:1787787146.425117:0:3275:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.206.110@tcp [8/256/0/180] 00008000:02000000:1.0:1787787149.759398:0:3425:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1787787192.181821:0:5226:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787787200.075226:0:5801:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787787200.075232:0:5801:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1787787200.075364:0:5801:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000cf6416c7 00000080:02000400:1.0:1787787200.075376:0:5801:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1787787200.079384:0:5801:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1787787200.079396:0:5801:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787787200.079542:0:5801:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000a599296b) 00000020:00000080:1.0:1787787200.079564:0:5801:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787787200.096400:0:5801:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787787200.097052:0:5801:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1787787200.114854:0:5801:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1787787200.114894:0:5801:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787787200.114915:0:5801:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1787787200.115043:0:5801:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787787200.115072:0:5801:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1787787200.116099:0:5801:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787787200.116108:0:5801:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787787200.116120:0:5801:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdeb1953cba4b0d5f 00000020:01000004:0.0:1787787200.116127:0:5801:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1787787200.116195:0:5801:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787787200.116201:0:5801:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000cf6416c7 from MGS 00000020:01000004:0.0:1787787200.116206:0:5801:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787787200.116230:0:5801:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000005d49b1d9) 00000020:00000080:0.0:1787787200.116242:0:5801:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787787200.116342:0:5801:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000cf6416c7 from MGS, refs=2 00080000:01000000:0.0:1787787200.116348:0:5801:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787787200.116353:0:5801:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdeb1953cba4b0d6d 00000100:00100000:0.0:1787787200.116603:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787787200.116739:0:5801:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787787200.116745:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787787200.119777:0:5801:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787787200.119790:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787787200.120624:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787787200.120814:0:5801:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787787200.120820:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787787200.121668:0:5801:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787787200.121677:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787787200.122128:0:5801:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787787200.122135:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0F:1787787200.123050:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787200.123059:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787200.123061:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787200.123564:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787200.123567:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787200.123568:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787200.124249:0:5801:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787787200.126614:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787787200.373545:0:5801:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2783 MB/s 00000001:01000000:2.0:1787787200.625023:0:5801:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3717 MB/s 00000001:01000000:3.0:1787787200.875155:0:5801:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 599 MB/s 00000001:01000000:2.0:1787787201.127090:0:5801:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 734 MB/s 00080000:10000000:2.0:1787787201.143132:0:5801:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:1.0:1787787201.148688:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787787201.172762:0:5801:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787787201.172789:0:5801:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787787201.172792:0:5801:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1787787201.174761:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787787201.174835:0:5801:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787787201.174897:0:5801:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1787787201.175104:0:5801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787787201.175131:0:5801:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787787201.178459:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787787201.178741:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787787201.178747:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787787201.180270:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787787201.180282:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787787201.180641:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787787201.180647:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787787201.183056:0:5801:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787787201.183078:0:5801:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.110@tcp' 00000020:01000004:2.0:1787787201.183080:0:5801:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787787201.183164:0:5801:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.110@tcp (typ=mgc) 00000020:00000080:2.0:1787787201.183190:0:5801:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.110@tcp (00000000863c2162) 00000020:00000080:2.0:1787787201.183207:0:5801:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787787201.183329:0:5801:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004fa18bd9@MGC192.168.206.110@tcp: add connection 192.168.206.110@tcp at head 00000100:00080000:3.0:1787787201.183515:0:5815:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:2.0:1787787201.188424:0:5801:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.110@tcp-0 is initialized 00000040:01000000:2.0:1787787201.188450:0:5801:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.110@tcp ctxt 1 is initialized 10000000:01000000:0.0:1787787201.192896:0:5817:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787787201.192940:0:5801:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.110@tcp (uuid 1500c007-b35b-4004-b231-bb5a7ec082ef) 00000020:00000080:0.0:1787787201.192962:0:5801:0:(genops.c:1385:class_connect()) connect: client 1500c007-b35b-4004-b231-bb5a7ec082ef, cookie 0xdeb1953cba4b0d7b 00000100:00080000:0.0:1787787201.192974:0:5801:0:(import.c:510:import_select_connection()) MGC192.168.206.110@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787787201.192985:0:5801:0:(import.c:624:import_select_connection()) MGC192.168.206.110@tcp: import 000000004fa18bd9 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:0.0:1787787201.193015:0:5801:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ac5a26e5 x1874630694404224/t0(0) o250->MGC192.168.206.110@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787787201.193133:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ac5a26e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1500c007-b35b-4004-b231-bb5a7ec082ef:3290:1874630694404224:0@lo:250: 00000100:00100000:0.0:1787787201.193224:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787787201.193283:0:5801:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 1500c007-b35b-4004-b231-bb5a7ec082ef->MGS 00000020:01000004:0.0:1787787201.193306:0:5801:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787787201.193310:0:5801:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787787201.193322:0:5801:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000fdaa9693) 00000020:00000080:0.0:1787787201.193334:0:5801:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787787201.193838:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694404224 00000100:00100000:2.0:1787787201.193846:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694404224 00000100:00100000:2.0:1787787201.193875:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787787201.193881:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4e86a0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3290:x1874630694404224:12345-0@lo:250: 00010000:00080000:2.0:1787787201.193912:0:5812:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 1500c007-b35b-4004-b231-bb5a7ec082ef@0@lo t0 exp 0000000000000000 cur 113 last 0 00000020:00000080:2.0:1787787201.193943:0:5812:0:(genops.c:1385:class_connect()) connect: client 1500c007-b35b-4004-b231-bb5a7ec082ef, cookie 0xdeb1953cba4b0d89 00000100:00080000:2.0:1787787201.194056:0:5812:0:(import.c:65:import_set_state_nolock()) 00000000e04badef : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787201.194157:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4e86a0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+5:3290:x1874630694404224:12345-0@lo:250: Request processed in 274us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787201.194165:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787787201.194211:0:3290:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.110@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787787201.194220:0:3290:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.110@tcp: connect to target with instance 0 00000100:00080000:2.0:1787787201.194232:0:3290:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.110@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787787201.194236:0:3290:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787787201.194239:0:3290:0:(import.c:65:import_set_state_nolock()) 000000004fa18bd9 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787787201.195280:0:3290:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787787201.195286:0:3290:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787787201.195295:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ac5a26e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1500c007-b35b-4004-b231-bb5a7ec082ef:3290:1874630694404224:0@lo:250: 00000100:00100000:0.0:1787787201.218633:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787787201.218936:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787787201.218943:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787787201.221630:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787787201.221648:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787787201.223767:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787787201.223780:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787787201.224433:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787787201.224959:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787787201.224964:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787787201.227595:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787787201.227611:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787787201.268019:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787787201.268226:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787787201.268233:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787787201.269300:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787787201.269310:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787787201.271169:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787787201.271367:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787787201.271373:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787787201.271999:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787787201.272006:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787787201.272577:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787787201.272702:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787787201.272707:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787787201.273228:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787787201.273234:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787787201.273868:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787787201.274017:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787787201.274023:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787787201.274555:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787787201.274563:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787787201.299742:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787787201.300023:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787787201.300097:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787787201.302537:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787787201.302551:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787787201.303498:0:5801:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787787201.303507:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787787201.305340:0:5801:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787787201.305365:0:5801:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787787201.305371:0:5801:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.110@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787787201.305628:0:5801:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.110@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787787201.305661:0:5801:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.110@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1787787201.305665:0:5801:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787787201.305667:0:5801:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787787201.305668:0:5801:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787787201.305669:0:5801:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787787201.305670:0:5801:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787787201.305672:0:5801:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787787201.305673:0:5801:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787787201.305674:0:5801:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787787201.305675:0:5801:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787787201.305677:0:5801:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787787201.305678:0:5801:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787787201.305679:0:5801:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787787201.305681:0:5801:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1787787201.305683:0:5801:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787787201.305684:0:5801:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787787201.305685:0:5801:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787787201.305686:0:5801:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787787201.305687:0:5801:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787787201.305688:0:5801:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787787201.305689:0:5801:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787787201.305690:0:5801:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787787201.305691:0:5801:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787787201.305692:0:5801:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787787201.305692:0:5801:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787787201.305693:0:5801:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787787201.305716:0:5801:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787787201.305734:0:5801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000057e90dc1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:5801:1874630694404352:0@lo:253: 00000100:00100000:2.0:1787787201.305874:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787201.305965:0:5801:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b0630757 going to sleep for 11 seconds 00000100:00100000:3.0:1787787201.306016:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694404352 00000100:00100000:3.0:1787787201.306091:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694404352 00000100:00100000:3.0:1787787201.306319:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787787201.306329:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006bfdfbc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+5:5801:x1874630694404352:12345-0@lo:253: 20000000:01000000:3.0:1787787201.306374:0:5814:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787787201.306377:0:5814:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1787787201.306913:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787787201.306962:0:5814:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1787787201.307578:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787787201.308700:0:5836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1787787201.309011:0:5814:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787787201.309015:0:5814:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1787787201.309020:0:5814:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1787787201.309033:0:5814:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1787787201.309047:0:5814:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1787787201.309538:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787787201.309764:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1787787201.309777:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787787201.309900:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1787787201.309950:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1787787201.309985:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1787787201.310361:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1787787201.310370:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1787787201.310426:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1787787201.310519:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1787787201.310567:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1787787201.310575:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1787787201.310602:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1787787201.310650:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1787787201.310687:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787787201.310693:0:5814:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1787787201.310705:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787787201.311264:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1787787201.311277:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787787201.311316:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1787787201.311351:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1787787201.312009:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1787787201.312099:0:5814:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1787787201.312366:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1787787201.312377:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787787201.312537:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1787787201.312581:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1787787201.312611:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1787787201.312622:0:5814:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1787787201.312696:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1787787201.312703:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1787787201.312730:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1787787201.312758:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1787787201.313326:0:5814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1787787201.313378:0:5814:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787787201.313385:0:5814:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1787787201.313966:0:5837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1787787201.314392:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1787787201.314434:0:5814:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.110@tcp for mdt 20000000:01000000:0.0:1787787201.316892:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.110@tcp (null) (null) (null) 00000040:00080000:1.0:1787787201.317305:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1787787201.317324:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787787201.317373:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1787787201.317381:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.110@tcp (null) (null) 00000040:00080000:1.0:1787787201.317587:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1787787201.317600:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1787787201.317636:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1787787201.317672:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1787787201.317784:0:5814:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787787201.317788:0:5814:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787787201.317867:0:5814:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787787201.317896:0:5814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787787201.317898:0:5814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787787201.317929:0:5814:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787787201.317932:0:5814:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787787201.318604:0:5838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1787787201.318911:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1787787201.318948:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1787787201.319020:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:1.0:1787787201.319096:0:5814:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787787201.319098:0:5814:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787787201.319873:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1787787201.320342:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1787787201.320387:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1787787201.322215:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1787787201.322248:0:5814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787787201.322251:0:5814:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1787787201.322256:0:5814:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787787201.322258:0:5814:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787787201.322263:0:5814:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1787787201.322268:0:5814:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1787787201.324750:0:5840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1787787201.331614:0:5814:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1787787201.340722:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1787787201.340777:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1787787201.340851:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1787787201.340891:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787787201.340910:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000007cfc2a3d/0xdeb1953cba4b0d90 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.340926:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007cfc2a3d/0xdeb1953cba4b0d90 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.340936:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007cfc2a3d/0xdeb1953cba4b0d90 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.340942:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007cfc2a3d/0xdeb1953cba4b0d90 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.340948:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000007cfc2a3d/0xdeb1953cba4b0d90 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.340960:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000007cfc2a3d/0xdeb1953cba4b0d90 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.340966:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007cfc2a3d already unused, calling callback (00000000aec634fb) 00010000:00010000:2.0:1787787201.340970:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000007cfc2a3d/0xdeb1953cba4b0d90 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.340976:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000007cfc2a3d/0xdeb1953cba4b0d90 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.340987:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000007cfc2a3d/0xdeb1953cba4b0d90 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.340994:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000007cfc2a3d/0xdeb1953cba4b0d90 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.341001:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007cfc2a3d/0xdeb1953cba4b0d90 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787787201.341023:0:5814:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787787201.544185:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006bfdfbc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+5:5801:x1874630694404352:12345-0@lo:253: Request processed in 237851us (238305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787201.544219:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787787201.544320:0:5801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000057e90dc1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:5801:1874630694404352:0@lo:253: 10000000:01000000:2.0:1787787201.544335:0:5801:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787787201.544338:0:5801:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787787201.544339:0:5801:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787787201.544341:0:5801:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787787201.544342:0:5801:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1787787201.544343:0:5801:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787787201.544344:0:5801:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787787201.544345:0:5801:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787787201.544346:0:5801:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787787201.544347:0:5801:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787787201.544349:0:5801:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787787201.544351:0:5801:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787787201.544370:0:5801:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000cf6416c7 from lustre-MDT0000 10000000:01000000:2.0:1787787201.544392:0:5801:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787787201.544395:0:5801:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787787201.544398:0:5801:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9d0703128000 10000000:01000000:2.0:1787787201.544401:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787787201.544419:0:5801:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9d0703128000 from 1 10000000:01000000:2.0:1787787201.544421:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787787201.544526:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: 000000007cfc2a3d/0xdeb1953cba4b0d97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.544536:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: 000000007cfc2a3d/0xdeb1953cba4b0d97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.544545:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: 000000007cfc2a3d/0xdeb1953cba4b0d97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787201.544562:0:5801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000057e90dc1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:5801:1874630694404480:0@lo:101: 00000100:00100000:2.0:1787787201.544604:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787201.544732:0:5801:0:(client.c:2715:ptlrpc_set_wait()) set 0000000002caba62 going to sleep for 11 seconds 00000100:00100000:3.0:1787787201.544776:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694404480 00000100:00100000:3.0:1787787201.544782:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694404480 00000100:00100000:3.0:1787787201.544831:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787787201.544839:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000575a21f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+5:5801:x1874630694404480:12345-0@lo:101: 00010000:00010000:3.0:1787787201.544851:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787201.544865:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000010336e68/0xdeb1953cba4b0d9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b0d97 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787201.544884:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000010336e68/0xdeb1953cba4b0d9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b0d97 expref: 6 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787201.544902:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000010336e68/0xdeb1953cba4b0d9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0d97 expref: 6 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787201.544910:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000010336e68, rc 0) 00000100:00100000:3.0:1787787201.544940:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000575a21f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+6:5801:x1874630694404480:12345-0@lo:101: Request processed in 103us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787201.544946:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787787201.545208:0:5801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000057e90dc1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:5801:1874630694404480:0@lo:101: 00010000:00010000:0.0:1787787201.545223:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: 000000007cfc2a3d/0xdeb1953cba4b0d97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0d9e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787201.545231:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: 000000007cfc2a3d/0xdeb1953cba4b0d97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b0d9e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787201.545277:0:5801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e64a3665 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:5801:1874630694404608:0@lo:501: 00000100:00100000:0.0:1787787201.545307:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787201.545368:0:5801:0:(client.c:2715:ptlrpc_set_wait()) set 0000000012cebef7 going to sleep for 11 seconds 00000100:00100000:1.0:1787787201.545415:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694404608 00000100:00100000:1.0:1787787201.545419:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694404608 00000100:00100000:1.0:1787787201.545466:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787787201.545473:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040d11067 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+6:5801:x1874630694404608:12345-0@lo:501: 00000100:00100000:1.0:1787787201.545737:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040d11067 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+6:5801:x1874630694404608:12345-0@lo:501: Request processed in 265us (430us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787787201.545745:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787787201.545877:0:5801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e64a3665 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:5801:1874630694404608:0@lo:501: 10000000:01000000:0.0:1787787201.545901:0:5801:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787787201.546033:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: 000000007cfc2a3d/0xdeb1953cba4b0d97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0d9e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787201.546042:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: 000000007cfc2a3d/0xdeb1953cba4b0d97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0d9e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787201.546050:0:5801:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d0722109800 10000000:01000000:0.0:1787787201.546055:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787787201.546059:0:5801:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9d0722109800 10000000:01000000:0.0:1787787201.546061:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787787201.546064:0:5801:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9d0722109800 from 1 10000000:01000000:0.0:1787787201.546066:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787787201.546087:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: 00000000c0289f6f/0xdeb1953cba4b0da5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787201.546104:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: 00000000c0289f6f/0xdeb1953cba4b0da5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787201.546111:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: 00000000c0289f6f/0xdeb1953cba4b0da5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787201.546125:0:5801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e64a3665 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:5801:1874630694404736:0@lo:101: 00000100:00100000:0.0:1787787201.546153:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787201.546183:0:5801:0:(client.c:2715:ptlrpc_set_wait()) set 0000000012cebef7 going to sleep for 11 seconds 00000100:00100000:2.0:1787787201.546273:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694404736 00000100:00100000:2.0:1787787201.546282:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694404736 00000100:00100000:2.0:1787787201.546315:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787787201.546322:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007fc29796 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+6:5801:x1874630694404736:12345-0@lo:101: 00010000:00010000:2.0:1787787201.546331:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787201.546342:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ef770ff7/0xdeb1953cba4b0dac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b0da5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.546359:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ef770ff7/0xdeb1953cba4b0dac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b0da5 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.546369:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ef770ff7/0xdeb1953cba4b0dac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0da5 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787201.546375:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ef770ff7, rc 0) 00000100:00100000:2.0:1787787201.546423:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007fc29796 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+7:5801:x1874630694404736:12345-0@lo:101: Request processed in 102us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787201.546430:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787787201.546590:0:5801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e64a3665 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:5801:1874630694404736:0@lo:101: 00010000:00010000:0.0:1787787201.546602:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: 00000000c0289f6f/0xdeb1953cba4b0da5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0dac expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787201.546609:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: 00000000c0289f6f/0xdeb1953cba4b0da5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b0dac expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787201.546620:0:5801:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787787201.546676:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: 00000000c0289f6f/0xdeb1953cba4b0da5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0dac expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787201.546683:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: 00000000c0289f6f/0xdeb1953cba4b0da5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0dac expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787201.546689:0:5801:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787787201.546693:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787787201.546697:0:5801:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9d0722109800 10000000:01000000:0.0:1787787201.546699:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787787201.546702:0:5801:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787787201.546710:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787787201.546723:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: 00000000092e1fcc/0xdeb1953cba4b0db3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787201.546730:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: 00000000092e1fcc/0xdeb1953cba4b0db3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787201.546736:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: 00000000092e1fcc/0xdeb1953cba4b0db3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787201.546747:0:5801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e64a3665 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:5801:1874630694404864:0@lo:101: 00000100:00100000:0.0:1787787201.546772:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787201.546791:0:5801:0:(client.c:2715:ptlrpc_set_wait()) set 0000000012cebef7 going to sleep for 11 seconds 00000100:00100000:3.0:1787787201.546890:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694404864 00000100:00100000:3.0:1787787201.546895:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694404864 00000100:00100000:3.0:1787787201.547174:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787787201.547182:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ad201a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+7:5801:x1874630694404864:12345-0@lo:101: 00010000:00010000:3.0:1787787201.547191:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787201.547199:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000058f73ea9/0xdeb1953cba4b0dba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b0db3 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787201.547215:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000058f73ea9/0xdeb1953cba4b0dba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b0db3 expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787201.547223:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000058f73ea9/0xdeb1953cba4b0dba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0db3 expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787201.547230:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000058f73ea9, rc 0) 00000100:00100000:3.0:1787787201.547270:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ad201a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+8:5801:x1874630694404864:12345-0@lo:101: Request processed in 90us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787201.547276:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787787201.547316:0:5801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e64a3665 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:5801:1874630694404864:0@lo:101: 00010000:00010000:0.0:1787787201.547327:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: 00000000092e1fcc/0xdeb1953cba4b0db3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0dba expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787201.547334:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: 00000000092e1fcc/0xdeb1953cba4b0db3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b0dba expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787201.547374:0:5801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e64a3665 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:5801:1874630694404992:0@lo:501: 00000100:00100000:0.0:1787787201.547399:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787201.547432:0:5801:0:(client.c:2715:ptlrpc_set_wait()) set 0000000012cebef7 going to sleep for 11 seconds 00000100:00100000:1.0:1787787201.547556:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694404992 00000100:00100000:1.0:1787787201.547561:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694404992 00000100:00100000:1.0:1787787201.547595:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787787201.547601:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000184f32d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+8:5801:x1874630694404992:12345-0@lo:501: 00000100:00100000:1.0:1787787201.548065:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000184f32d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+9:5801:x1874630694404992:12345-0@lo:501: Request processed in 463us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787201.548073:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787787201.548178:0:5801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e64a3665 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:5801:1874630694404992:0@lo:501: 00000100:00100000:0.0:1787787201.548209:0:5801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e64a3665 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:5801:1874630694405120:0@lo:503: 00000100:00100000:0.0:1787787201.548249:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787201.548318:0:5801:0:(client.c:2715:ptlrpc_set_wait()) set 0000000012cebef7 going to sleep for 11 seconds 00000100:00100000:3.0:1787787201.548352:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694405120 00000100:00100000:3.0:1787787201.548357:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694405120 00000100:00100000:3.0:1787787201.548470:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787787201.548484:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058ecb0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+9:5801:x1874630694405120:12345-0@lo:503: 00000100:00100000:3.0:1787787201.548632:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058ecb0aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+9:5801:x1874630694405120:12345-0@lo:503: Request processed in 149us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787201.548639:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787787201.548720:0:5801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e64a3665 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:5801:1874630694405120:0@lo:503: 00000100:00100000:0.0:1787787201.549135:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e64a3665 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:5843:1874630694405248:0@lo:502: 00000100:00100000:0.0:1787787201.549173:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787201.549457:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set 000000005e3cf2b0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787201.549471:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694405248 00000100:00100000:2.0:1787787201.550171:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694405248 00000100:00100000:2.0:1787787201.550231:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787787201.550239:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006137d54f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+9:5843:x1874630694405248:12345-0@lo:502: 00000100:00100000:3.0:1787787201.552693:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006137d54f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+9:5843:x1874630694405248:12345-0@lo:502: Request processed in 2449us (3514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787201.552708:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787787201.552772:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e64a3665 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:5843:1874630694405248:0@lo:502: 00000020:01000000:0.0:1787787201.552817:0:5843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787201.552829:0:5843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787201.552831:0:5843:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787787201.552837:0:5843:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787787201.552840:0:5843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787787201.552854:0:5843:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000009d58d5e0) 00000020:00000080:0.0:1787787201.552872:0:5843:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787787201.552877:0:5843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787787201.552954:0:5843:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787787201.552961:0:5843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdeb1953cba4b0dc8 00000020:00000080:0.0:1787787201.553232:0:5843:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787787201.553236:0:5843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787201.553239:0:5843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787201.553240:0:5843:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787787201.553243:0:5843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787201.553246:0:5843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787201.553247:0:5843:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787787201.553250:0:5843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787787201.553256:0:5843:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000f2538e38) 00000020:00000080:0.0:1787787201.553265:0:5843:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787787201.553268:0:5843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787787201.553270:0:5843:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787787201.553272:0:5843:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787787201.553277:0:5843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787787201.553312:0:5843:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000cf6416c7 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787787201.553329:0:5843:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000003bf6d398) 00000020:00000080:0.0:1787787201.553342:0:5843:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787787201.553397:0:5843:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787787201.553401:0:5843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdeb1953cba4b0ddd 00000020:00000080:0.0:1787787201.553527:0:5843:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787787201.553534:0:5843:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787787201.553538:0:5843:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xdeb1953cba4b0de4 00080000:01000000:0.0:1787787201.553543:0:5843:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787787201.553547:0:5843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdeb1953cba4b0deb 00080000:10000000:0.0:1787787201.553918:0:5843:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1787787201.554119:0:5843:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1787787201.565591:0:5843:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1787787201.655346:0:5843:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787787201.656373:0:5843:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787787201.660879:0:5843:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787787201.661630:0:5843:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787787201.696226:0:5843:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000b40921a3) 00000020:00000080:1.0:1787787201.696266:0:5843:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787787201.696326:0:5843:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787787201.696332:0:5843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdeb1953cba4b0df9 00000020:00000080:1.0:1787787201.700110:0:5843:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1787787201.701652:0:5843:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787787201.746175:0:5843:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787787201.782175:0:5843:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787787201.827989:0:5843:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787787201.869334:0:5843:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787787201.905246:0:5843:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1787787201.942233:0:5843:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xdeb1953cba4b0e00 00000020:00000080:0.0:1787787201.943319:0:5843:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787787201.943333:0:5843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787201.943339:0:5843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787201.943342:0:5843:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787787201.943345:0:5843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787201.943349:0:5843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787201.943351:0:5843:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787787201.943353:0:5843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787787201.943355:0:5843:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787787201.943357:0:5843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787201.943360:0:5843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787201.943361:0:5843:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787787201.943363:0:5843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787201.943367:0:5843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787201.943368:0:5843:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787787201.943372:0:5843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787787201.943417:0:5843:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1787787201.943487:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e64a3665 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:5843:1874630694405376:0@lo:502: 00000100:00100000:0.0:1787787201.943566:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787201.943748:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set 000000005e3cf2b0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787201.943825:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694405376 00000100:00100000:3.0:1787787201.943832:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694405376 00000100:00100000:3.0:1787787201.943867:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787787201.943873:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5823c05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+9:5843:x1874630694405376:12345-0@lo:502: 00000100:00100000:3.0:1787787201.944366:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5823c05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+9:5843:x1874630694405376:12345-0@lo:502: Request processed in 491us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787201.944375:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787787201.944547:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e64a3665 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:5843:1874630694405376:0@lo:502: 00000020:01000000:0.0:1787787201.944648:0:5843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787201.944719:0:5843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787201.944721:0:5843:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1787787201.944726:0:5843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1787787201.944847:0:5801:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1787787201.944865:0:5801:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787787201.944886:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: 00000000092e1fcc/0xdeb1953cba4b0db3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0dba expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787201.944904:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: 00000000092e1fcc/0xdeb1953cba4b0db3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0dba expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787201.944912:0:5801:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d0722109800 from 1 10000000:01000000:1.0:1787787201.944915:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787787201.944942:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: 000000001b7f7570/0xdeb1953cba4b0e07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787201.944949:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: 000000001b7f7570/0xdeb1953cba4b0e07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787201.944957:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: 000000001b7f7570/0xdeb1953cba4b0e07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787201.944971:0:5801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000669aa25d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:5801:1874630694405504:0@lo:101: 00000100:00100000:1.0:1787787201.945006:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787201.945028:0:5801:0:(client.c:2715:ptlrpc_set_wait()) set 000000001fd57455 going to sleep for 11 seconds 00000100:00100000:3.0:1787787201.945156:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694405504 00000100:00100000:3.0:1787787201.945161:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694405504 00000100:00100000:3.0:1787787201.945200:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787787201.945207:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c97ff0f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+9:5801:x1874630694405504:12345-0@lo:101: 00010000:00010000:3.0:1787787201.945217:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787201.945230:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000043aae460/0xdeb1953cba4b0e0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b0e07 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787201.945251:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000043aae460/0xdeb1953cba4b0e0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b0e07 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787201.945259:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000043aae460/0xdeb1953cba4b0e0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0e07 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787201.945273:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000043aae460, rc 0) 00000100:00100000:3.0:1787787201.945304:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c97ff0f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+10:5801:x1874630694405504:12345-0@lo:101: Request processed in 99us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787201.945310:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787787201.945534:0:5801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000669aa25d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:5801:1874630694405504:0@lo:101: 00010000:00010000:1.0:1787787201.945545:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: 000000001b7f7570/0xdeb1953cba4b0e07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0e0e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787201.945552:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: 000000001b7f7570/0xdeb1953cba4b0e07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b0e0e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787201.946531:0:5801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000669aa25d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:5801:1874630694405632:0@lo:256: 00000100:00100000:1.0:1787787201.946600:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787201.946639:0:5801:0:(client.c:2715:ptlrpc_set_wait()) set 000000001fd57455 going to sleep for 11 seconds 00000100:00100000:1.0:1787787201.946794:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694405632 00000100:00100000:1.0:1787787201.946800:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694405632 00000100:00100000:1.0:1787787201.946835:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787787201.946842:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000903b6f95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+10:5801:x1874630694405632:12345-0@lo:256: 20000000:01000000:1.0:1787787201.946859:0:5813:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787787201.946864:0:5813:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787787201.946932:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000903b6f95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+10:5801:x1874630694405632:12345-0@lo:256: Request processed in 91us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787201.946938:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787787201.946974:0:5801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000669aa25d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:5801:1874630694405632:0@lo:256: 10000000:01000000:1.0:1787787201.947779:0:5801:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787787201.947801:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: 000000001b7f7570/0xdeb1953cba4b0e07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0e0e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787201.947812:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: 000000001b7f7570/0xdeb1953cba4b0e07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0e0e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787201.947820:0:5801:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d0722109800 from 1 10000000:01000000:1.0:1787787201.947823:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787787201.947849:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: 00000000ada845b7/0xdeb1953cba4b0e15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787201.947856:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: 00000000ada845b7/0xdeb1953cba4b0e15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787201.947864:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: 00000000ada845b7/0xdeb1953cba4b0e15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787201.947879:0:5801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000669aa25d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:5801:1874630694405760:0@lo:101: 00000100:00100000:1.0:1787787201.947927:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787201.947956:0:5801:0:(client.c:2715:ptlrpc_set_wait()) set 000000001fd57455 going to sleep for 11 seconds 00000100:00100000:3.0:1787787201.948016:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694405760 00000100:00100000:3.0:1787787201.948021:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694405760 00000100:00100000:3.0:1787787201.948135:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787787201.948142:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec11565c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+10:5801:x1874630694405760:12345-0@lo:101: 00010000:00010000:3.0:1787787201.948152:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787201.948164:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ecd1ba0f/0xdeb1953cba4b0e1c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b0e15 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787201.948183:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ecd1ba0f/0xdeb1953cba4b0e1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b0e15 expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787201.948191:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ecd1ba0f/0xdeb1953cba4b0e1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0e15 expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787201.948198:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ecd1ba0f, rc 0) 00000100:00100000:3.0:1787787201.948236:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec11565c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+11:5801:x1874630694405760:12345-0@lo:101: Request processed in 95us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787201.948242:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787787201.948274:0:5801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000669aa25d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:5801:1874630694405760:0@lo:101: 00010000:00010000:1.0:1787787201.948285:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: 00000000ada845b7/0xdeb1953cba4b0e15 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0e1c expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787201.948293:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: 00000000ada845b7/0xdeb1953cba4b0e15 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b0e1c expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787201.948346:0:5801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000669aa25d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:5801:1874630694405888:0@lo:501: 00000100:00100000:1.0:1787787201.948373:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787201.948394:0:5801:0:(client.c:2715:ptlrpc_set_wait()) set 000000001fd57455 going to sleep for 11 seconds 00000100:00100000:3.0:1787787201.948523:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694405888 00000100:00100000:3.0:1787787201.948527:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694405888 00000100:00100000:3.0:1787787201.948549:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787787201.948555:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014b8308a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+11:5801:x1874630694405888:12345-0@lo:501: 00000100:00100000:3.0:1787787201.949542:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014b8308a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+11:5801:x1874630694405888:12345-0@lo:501: Request processed in 983us (1165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787201.949559:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787787201.949808:0:5801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000669aa25d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:5801:1874630694405888:0@lo:501: 00000100:00100000:1.0:1787787201.949841:0:5801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000669aa25d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:5801:1874630694406016:0@lo:503: 00000100:00100000:1.0:1787787201.949873:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787201.949897:0:5801:0:(client.c:2715:ptlrpc_set_wait()) set 000000001fd57455 going to sleep for 11 seconds 00000100:00100000:3.0:1787787201.949905:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694406016 00000100:00100000:3.0:1787787201.949920:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694406016 00000100:00100000:3.0:1787787201.950221:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787787201.950233:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026a4692c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+11:5801:x1874630694406016:12345-0@lo:503: 00000040:00080000:3.0:1787787201.950272:0:5813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787787201.950323:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026a4692c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+11:5801:x1874630694406016:12345-0@lo:503: Request processed in 93us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787201.950329:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787787201.950755:0:5801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000669aa25d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:5801:1874630694406016:0@lo:503: 00000040:00080000:3.0:1787787201.951805:0:5847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1787787201.952134:0:5801:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1787787201.952153:0:5801:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787787201.952172:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: 00000000ada845b7/0xdeb1953cba4b0e15 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0e1c expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787201.952182:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: 00000000ada845b7/0xdeb1953cba4b0e15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0e1c expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787201.952219:0:5801:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787787201.952223:0:5801:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d0722109800 10000000:01000000:1.0:1787787201.952235:0:5801:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d0722109800 10000000:01000000:1.0:1787787201.952239:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787787201.952244:0:5801:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d0722109800 from 1 10000000:01000000:1.0:1787787201.952247:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787787201.952275:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: 000000002ee10275/0xdeb1953cba4b0e23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787201.952281:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: 000000002ee10275/0xdeb1953cba4b0e23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787201.952289:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: 000000002ee10275/0xdeb1953cba4b0e23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787201.952306:0:5801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000669aa25d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:5801:1874630694406144:0@lo:101: 00000100:00100000:1.0:1787787201.952356:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787201.952398:0:5801:0:(client.c:2715:ptlrpc_set_wait()) set 000000006d802978 going to sleep for 11 seconds 00000100:00100000:0.0:1787787201.952787:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694406144 00000100:00100000:0.0:1787787201.952793:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694406144 00000100:00100000:0.0:1787787201.952839:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787787201.952846:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005442c54a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+11:5801:x1874630694406144:12345-0@lo:101: 00010000:00010000:0.0:1787787201.952858:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787201.952871:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000678d735f/0xdeb1953cba4b0e2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b0e23 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787201.952892:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000678d735f/0xdeb1953cba4b0e2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b0e23 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787201.952902:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000678d735f/0xdeb1953cba4b0e2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0e23 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787201.952919:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000678d735f, rc 0) 00000100:00100000:0.0:1787787201.952956:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005442c54a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+12:5801:x1874630694406144:12345-0@lo:101: Request processed in 111us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787201.952962:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787787201.953326:0:5801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000669aa25d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:5801:1874630694406144:0@lo:101: 00010000:00010000:1.0:1787787201.953342:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: 000000002ee10275/0xdeb1953cba4b0e23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0e2a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787201.953351:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: 000000002ee10275/0xdeb1953cba4b0e23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b0e2a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787201.953416:0:5801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000669aa25d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:5801:1874630694406272:0@lo:501: 00000100:00100000:1.0:1787787201.953476:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787201.953505:0:5801:0:(client.c:2715:ptlrpc_set_wait()) set 000000006d802978 going to sleep for 11 seconds 00000100:00100000:3.0:1787787201.953515:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694406272 00000100:00100000:3.0:1787787201.953519:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694406272 00000100:00100000:3.0:1787787201.953547:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787787201.953553:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d074f96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+12:5801:x1874630694406272:12345-0@lo:501: 00000100:00100000:3.0:1787787201.953937:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d074f96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+12:5801:x1874630694406272:12345-0@lo:501: Request processed in 384us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787201.953945:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787787201.953961:0:5801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000669aa25d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:5801:1874630694406272:0@lo:501: 00000100:00100000:1.0:1787787201.954007:0:5801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000669aa25d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:5801:1874630694406400:0@lo:503: 00000100:00100000:1.0:1787787201.954054:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787201.954072:0:5801:0:(client.c:2715:ptlrpc_set_wait()) set 000000006d802978 going to sleep for 11 seconds 00000100:00100000:3.0:1787787201.954128:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694406400 00000100:00100000:3.0:1787787201.954132:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694406400 00000100:00100000:3.0:1787787201.954162:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787787201.954168:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d003582 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+12:5801:x1874630694406400:12345-0@lo:503: 00000100:00100000:3.0:1787787201.954486:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d003582 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+12:5801:x1874630694406400:12345-0@lo:503: Request processed in 318us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787201.954493:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787787201.954548:0:5801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000669aa25d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:5801:1874630694406400:0@lo:503: 00000100:00100000:0.0:1787787201.955530:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e64a3665 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:5848:1874630694406528:0@lo:502: 00000100:00100000:0.0:1787787201.956117:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787201.956160:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set 00000000acb6c50b going to sleep for 11 seconds 00000100:00100000:1.0:1787787201.956177:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694406528 00000100:00100000:1.0:1787787201.956184:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694406528 00000100:00100000:1.0:1787787201.956225:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787787201.956232:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045117844 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+12:5848:x1874630694406528:12345-0@lo:502: 00000100:00100000:1.0:1787787201.956546:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045117844 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+12:5848:x1874630694406528:12345-0@lo:502: Request processed in 314us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787201.956553:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787787201.956734:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e64a3665 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:5848:1874630694406528:0@lo:502: 00000020:01000004:0.0:1787787201.956802:0:5848:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787787201.956816:0:5848:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000007b43c16) 00000020:00000080:0.0:1787787201.956837:0:5848:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1787787201.956904:0:5848:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000cf6416c7 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787787201.956918:0:5848:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000cf6416c7 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787787201.956921:0:5848:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000cf6416c7 4 00010000:00080000:0.0:1787787201.956949:0:5848:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a580055c@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.110@tcp at head 00010000:00010000:1.0:1787787201.960185:0:5848:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1787787201.961671:0:5848:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787787201.961714:0:5848:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787787201.961745:0:5848:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xdeb1953cba4b0e38 00000100:00080000:1.0:1787787201.961755:0:5848:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787787201.961760:0:5848:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000a580055c using connection 192.168.206.110@tcp/0@lo 00000100:00100000:1.0:1787787201.961794:0:5848:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000669aa25d x1874630694406656/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787787201.961820:0:5848:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787787201.963217:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000669aa25d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1874630694406656:0@lo:38: 00000100:00100000:0.0:1787787201.963289:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787201.963478:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e343ee7d pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:5848:1874630694406784:0@lo:502: 00000100:00100000:0.0:1787787201.963519:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787201.963544:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694406784 00000100:00100000:0.0:1787787201.963550:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694406784 00000100:00100000:0.0:1787787201.963591:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787787201.963598:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c466c35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+12:5848:x1874630694406784:12345-0@lo:502: 00000100:00100000:0.0:1787787201.963811:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c466c35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+12:5848:x1874630694406784:12345-0@lo:502: Request processed in 212us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787201.963819:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787787201.963909:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set 000000002b8097fd going to sleep for 11 seconds 00000100:00100000:0.0:1787787201.963928:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e343ee7d pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:5848:1874630694406784:0@lo:502: 00000040:00080000:0.0:1787787201.963950:0:5848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1787787201.964102:0:5801:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1787787201.964118:0:5801:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787787201.964137:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: 000000002ee10275/0xdeb1953cba4b0e23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0e2a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787201.964147:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: 000000002ee10275/0xdeb1953cba4b0e23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0e2a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787787201.964195:0:5801:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787787201.964198:0:5801:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787787201.964199:0:5801:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787787201.964200:0:5801:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787787201.964201:0:5801:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787787201.964202:0:5801:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787787201.964204:0:5801:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787787201.964205:0:5801:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787787201.964207:0:5801:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787787201.964208:0:5801:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787787201.964209:0:5801:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787787201.964211:0:5801:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787787201.964214:0:5801:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1787787201.964216:0:5801:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787787201.964217:0:5801:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787787201.964218:0:5801:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787787201.964219:0:5801:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787787201.964220:0:5801:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787787201.964221:0:5801:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787787201.964222:0:5801:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787787201.964223:0:5801:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787787201.964224:0:5801:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787787201.964225:0:5801:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787787201.964226:0:5801:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787787201.964226:0:5801:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787787201.964241:0:5801:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787787201.964250:0:5801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b4e08d83 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:5801:1874630694406912:0@lo:253: 00000100:00100000:1.0:1787787201.964286:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787201.964307:0:5801:0:(client.c:2715:ptlrpc_set_wait()) set 000000001fd57455 going to sleep for 11 seconds 00000100:00100000:0.0:1787787201.964422:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694406912 00000100:00100000:0.0:1787787201.964428:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694406912 00000100:00100000:0.0:1787787201.964478:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787787201.964484:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea492f02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+12:5801:x1874630694406912:12345-0@lo:253: 20000000:01000000:0.0:1787787201.964501:0:5813:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787787201.964512:0:5813:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787787201.965902:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694406656 00000100:00100000:2.0:1787787201.965930:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694406656 00000100:00100000:2.0:1787787201.965962:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787787201.965967:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e64a3665 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3290:x1874630694406656:12345-0@lo:38: 00000100:00100000:2.0:1787787201.967210:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e64a3665 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3290:x1874630694406656:12345-0@lo:38: Request processed in 73us (2752us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787787201.967227:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787787201.968468:0:3290:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787787201.968478:0:3290:0:(import.c:65:import_set_state_nolock()) 00000000a580055c lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787787201.968489:0:3290:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787787201.968494:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000669aa25d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1874630694406656:0@lo:38: 20000000:01000000:0.0:1787787202.019901:0:5813:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787787202.019922:0:5813:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787787202.019969:0:5835:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787787202.019975:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787787202.019994:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d7ea3c40/0xdeb1953cba4b0e3f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787202.020013:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000043aae460/0xdeb1953cba4b0e0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0e07 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787202.020020:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d7ea3c40/0xdeb1953cba4b0e3f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787202.020067:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000043aae460/0xdeb1953cba4b0e0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b0e07 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787202.020082:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000043aae460/0xdeb1953cba4b0e0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b0e07 expref: 12 pid: 5812 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787202.020097:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000686ca775 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5835:1874630694407040:0@lo:104: 00000100:00100000:2.0:1787787202.020158:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787202.020211:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a6bd673b going to sleep for 11 seconds 00000100:00100000:0.0:1787787202.020478:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694407040 00000100:00100000:0.0:1787787202.020485:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694407040 00000100:00100000:0.0:1787787202.020527:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787787202.020535:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057e90dc1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1500c007-b35b-4004-b231-bb5a7ec082ef+3:5835:x1874630694407040:12345-0@lo:104: 00010000:00010000:0.0:1787787202.020546:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: 000000001b7f7570/0xdeb1953cba4b0e07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0e0e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787202.020599:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787787202.020604:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057e90dc1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1500c007-b35b-4004-b231-bb5a7ec082ef+3:5835:x1874630694407040:12345-0@lo:104: Request processed in 70us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787202.020611:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787787202.020689:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000686ca775 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5835:1874630694407040:0@lo:104: 00010000:00010000:2.0:1787787202.020705:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d7ea3c40/0xdeb1953cba4b0e3f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787202.020720:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787202.020736:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: 000000001b7f7570/0xdeb1953cba4b0e07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0e0e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787202.020743:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001b7f7570 already unused, calling callback (00000000ef0195c9) 10000000:00010000:2.0:1787787202.020745:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: 000000001b7f7570/0xdeb1953cba4b0e07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b0e0e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787202.020753:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: 000000001b7f7570/0xdeb1953cba4b0e07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b0e0e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787202.020759:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: 000000001b7f7570/0xdeb1953cba4b0e07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b0e0e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787202.020765:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787787202.020835:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: 000000001b7f7570/0xdeb1953cba4b0e07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0e0e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787202.020843:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787202.020860:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: 000000001b7f7570/0xdeb1953cba4b0e07 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0e0e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787202.020867:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: 000000001b7f7570/0xdeb1953cba4b0e07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0e0e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787202.020881:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787202.020883:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787202.020885:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787202.020929:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000686ca775 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694407168:0@lo:103: 00000100:00100000:2.0:1787787202.020957:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787202.021338:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694407168 00000100:00100000:3.0:1787787202.021344:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694407168 00010000:00010000:3.0:1787787202.021376:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000043aae460/0xdeb1953cba4b0e0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0e07 expref: 13 pid: 5812 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787202.021419:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787787202.021426:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057985eb9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1500c007-b35b-4004-b231-bb5a7ec082ef+13:3292:x1874630694407168:12345-0@lo:103: 00010000:00010000:3.0:1787787202.021457:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787202.021462:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000043aae460/0xdeb1953cba4b0e0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0e07 expref: 13 pid: 5812 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787202.021471:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000043aae460/0xdeb1953cba4b0e0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b0e07 expref: 13 pid: 5812 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787202.021486:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000043aae460/0xdeb1953cba4b0e0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b0e07 expref: 13 pid: 5812 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787202.021499:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d7ea3c40/0xdeb1953cba4b0e3f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787202.021506:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d7ea3c40/0xdeb1953cba4b0e3f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787787202.021520:0:5805:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001546914s 00010000:00010000:3.0:1787787202.021524:0:5805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d7ea3c40/0xdeb1953cba4b0e3f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787202.021530:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d7ea3c40/0xdeb1953cba4b0e3f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787202.021536:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d7ea3c40/0xdeb1953cba4b0e3f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787202.021542:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d7ea3c40/0xdeb1953cba4b0e3f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787202.021553:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d7ea3c40 already unused, calling callback (00000000aec634fb) 00010000:00010000:3.0:1787787202.021557:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d7ea3c40/0xdeb1953cba4b0e3f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787202.021564:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d7ea3c40/0xdeb1953cba4b0e3f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787202.021577:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d7ea3c40/0xdeb1953cba4b0e3f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787202.021586:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787202.021620:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057985eb9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1500c007-b35b-4004-b231-bb5a7ec082ef+12:3292:x1874630694407168:12345-0@lo:103: Request processed in 195us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787202.021627:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787787202.021653:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000686ca775 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694407168:0@lo:103: 00010000:00010000:3.0:1787787202.021670:0:5835:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d7ea3c40/0xdeb1953cba4b0e3f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787202.021676:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d7ea3c40/0xdeb1953cba4b0e3f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787202.021683:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d7ea3c40/0xdeb1953cba4b0e3f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787202.028977:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea492f02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+11:5801:x1874630694406912:12345-0@lo:253: Request processed in 64487us (64685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787202.028993:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787787202.029184:0:5801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b4e08d83 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:5801:1874630694406912:0@lo:253: 10000000:01000000:2.0:1787787202.029216:0:5801:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787787202.029220:0:5801:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787787202.029221:0:5801:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787787202.029223:0:5801:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787787202.029224:0:5801:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787787202.029225:0:5801:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787787202.029226:0:5801:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787787202.029227:0:5801:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787787202.029228:0:5801:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787787202.029229:0:5801:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787787202.029231:0:5801:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787787202.029232:0:5801:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787787202.029234:0:5801:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787787202.029249:0:5801:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787787202.034311:0:5801:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787787202.034957:0:5801:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787787202.035672:0:5801:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787787202.035847:0:5801:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787787202.036621:0:5801:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787787202.036809:0:5801:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787787202.037733:0:5801:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787787202.037919:0:5801:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787787202.038228:0:5801:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787787202.038518:0:5801:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787787202.038696:0:5801:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787787202.038879:0:5801:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1787787202.093318:0:5801:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1787787202.121683:0:5801:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1787787202.121745:0:5853:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1787787202.121749:0:5853:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1787787202.122161:0:5854:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787787202.124977:0:5801:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787787202.125132:0:5801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787787202.126129:0:5801:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787787202.126273:0:5801:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787787202.126854:0:5801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787787202.128271:0:5801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787787202.129301:0:5801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787787202.129339:0:5801:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1787787202.129729:0:5801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787787202.129933:0:5801:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1787787202.131828:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1787787202.131969:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1787787202.132233:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1787787202.132595:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1787787202.132772:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1787787202.132907:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1787787202.133166:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787787202.133300:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787787202.133603:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787787202.133732:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787787202.138578:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787787202.138805:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787787202.138958:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787787202.141222:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787787202.142040:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1787787202.142655:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1787787202.144353:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1787787202.144620:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1787787202.144755:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1787787202.144968:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1787787202.145268:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787787202.145511:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787787202.145683:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787787202.145921:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787787202.146063:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787787202.146313:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787787202.146616:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787787202.146779:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787787202.147009:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787787202.147281:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787787202.147529:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787787202.147694:0:5801:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787787202.147945:0:5801:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1787787202.168784:0:5854:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00010000:3.0:1787787202.172594:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787787202.240632:0:5801:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787787202.240661:0:5801:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb6cdc1c93988 00100000:10000000:2.0:1787787202.240668:0:5801:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787787202.243384:0:5801:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787787202.244210:0:5801:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.110@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787787202.244233:0:5801:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1787787202.244251:0:5801:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1787787202.246139:0:5854:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787787202.246385:0:5854:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787787202.246390:0:5854:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1787787203.196718:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787204.224796:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787205.246375:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787206.269648:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787207.036878:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:2.0:1787787207.037472:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787787207.037480:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787787207.037483:0:36:0:(import.c:65:import_set_state_nolock()) 00000000a580055c lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787787207.037499:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000a580055c using connection 192.168.206.110@tcp/0@lo 00000100:00100000:2.0:1787787207.037531:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000011f6ce0a x1874630694407424/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787787207.038263:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000011f6ce0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1874630694407424:0@lo:38: 00000100:00100000:0.0:1787787207.038358:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787207.038563:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694407424 00000100:00100000:2.0:1787787207.038574:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694407424 00000100:00100000:2.0:1787787207.038611:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787787207.038618:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f181483 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3290:x1874630694407424:12345-0@lo:38: 00010000:00080000:2.0:1787787207.038650:0:5821:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 119 last 0 00000020:00000080:2.0:1787787207.038693:0:5821:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xdeb1953cba4b0e46 00000004:00100000:2.0:1787787207.038747:0:5821:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787787207.038901:0:5821:0:(import.c:65:import_set_state_nolock()) 000000008891b0bc : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787207.039097:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f181483 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1874630694407424:12345-0@lo:38: Request processed in 477us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787207.039105:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787787207.039222:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000011f6ce0a x1874630694407424/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787787217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787787207.039241:0:3290:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787787207.039250:0:3290:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787787207.039255:0:3290:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787787207.039257:0:3290:0:(import.c:65:import_set_state_nolock()) 00000000a580055c lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787787207.039264:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000011f6ce0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1874630694407424:0@lo:38: 00000100:00100000:1.0:1787787207.040150:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bcbeff6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694407296:0@lo:400: 00000100:00100000:1.0:1787787207.040529:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787207.040664:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694407296 00000100:00100000:0.0:1787787207.040675:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694407296 00000100:00100000:0.0:1787787207.040736:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787787207.040744:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a551982 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+11:3294:x1874630694407296:12345-0@lo:400: 00000100:00100000:0.0:1787787207.040801:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a551982 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+11:3294:x1874630694407296:12345-0@lo:400: Request processed in 58us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787207.040807:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787787207.041016:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bcbeff6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694407296:0@lo:400: 00000001:02000400:2.0:1787787207.167239:0:6097:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787787207.294329:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787208.317033:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787209.344474:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787787210.115166:0:5817:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787787210.115175:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d0722109800 from 3 10000000:01000000:1.0:1787787210.115179:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787787210.115225:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: 00000000855dd827/0xdeb1953cba4b0e4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787210.115237:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: 00000000855dd827/0xdeb1953cba4b0e4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787210.115247:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: 00000000855dd827/0xdeb1953cba4b0e4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787210.115271:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000346be051 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694407552:0@lo:101: 00000100:00100000:1.0:1787787210.115339:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787210.115402:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set 000000002ea60b88 going to sleep for 11 seconds 00000100:00100000:0.0:1787787210.118226:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694407552 00000100:00100000:0.0:1787787210.118242:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694407552 00000100:00100000:0.0:1787787210.118299:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787787210.118309:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab795c21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+11:5817:x1874630694407552:12345-0@lo:101: 00010000:00010000:0.0:1787787210.118325:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787210.118343:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004dd24d47/0xdeb1953cba4b0e54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b0e4d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787210.118380:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004dd24d47/0xdeb1953cba4b0e54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b0e4d expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787210.118390:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004dd24d47/0xdeb1953cba4b0e54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0e4d expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787210.118399:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004dd24d47, rc 0) 00000100:00100000:0.0:1787787210.118515:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab795c21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+12:5817:x1874630694407552:12345-0@lo:101: Request processed in 208us (3176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787210.118522:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787787210.118848:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000346be051 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694407552:0@lo:101: 00010000:00010000:3.0:1787787210.118865:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: 00000000855dd827/0xdeb1953cba4b0e4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0e54 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787210.118874:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: 00000000855dd827/0xdeb1953cba4b0e4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b0e54 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787210.118937:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b76437d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694407680:0@lo:256: 00000100:00100000:3.0:1787787210.118990:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787210.119038:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set 0000000085d25411 going to sleep for 11 seconds 00000100:00100000:0.0:1787787210.119845:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694407680 00000100:00100000:0.0:1787787210.119854:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694407680 00000100:00100000:0.0:1787787210.119891:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787787210.119898:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f166da53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+12:5817:x1874630694407680:12345-0@lo:256: 20000000:01000000:0.0:1787787210.119923:0:5812:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787787210.119937:0:5812:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787787210.119940:0:5812:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787787210.120367:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f166da53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+12:5817:x1874630694407680:12345-0@lo:256: Request processed in 459us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787210.120376:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787787210.120480:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b76437d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694407680:0@lo:256: 10000000:01000000:3.0:1787787210.120686:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787787210.120699:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: 00000000855dd827/0xdeb1953cba4b0e4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0e54 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787210.120710:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: 00000000855dd827/0xdeb1953cba4b0e4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0e54 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787210.364953:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787211.388666:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787787211.651210:0:6299:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc7f0e3d40 20000000:00000080:1.0:1787787211.651234:0:6299:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d073d8c9c00 uarg=0000000000000000 20000000:01000000:1.0:1787787211.651276:0:6299:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787787211.651284:0:6299:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787787211.651290:0:6299:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787787211.651682:0:6299:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1787787211.651696:0:6299:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1787787211.658853:0:6299:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787787211.659271:0:6299:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787787211.659357:0:6299:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1787787211.659413:0:6299:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1787787211.659483:0:6299:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787787211.659522:0:6299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001b7f7570/0xdeb1953cba4b0e5b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787211.659548:0:6299:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ecd1ba0f/0xdeb1953cba4b0e1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0e15 expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787211.659557:0:6299:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001b7f7570/0xdeb1953cba4b0e5b lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787211.659681:0:6299:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ecd1ba0f/0xdeb1953cba4b0e1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b0e15 expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787211.659700:0:6299:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ecd1ba0f/0xdeb1953cba4b0e1c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b0e15 expref: 11 pid: 5813 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787211.659716:0:6299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b175822 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6299:1874630694407808:0@lo:104: 00000100:00100000:1.0:1787787211.659800:0:6299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787211.660049:0:6299:0:(client.c:2715:ptlrpc_set_wait()) set 000000007c2d2b1d going to sleep for 11 seconds 00000100:00100000:2.0:1787787211.667810:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694407808 00000100:00100000:2.0:1787787211.667831:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694407808 00000100:00100000:2.0:1787787211.667909:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787787211.667921:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000346be051 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+3:6299:x1874630694407808:12345-0@lo:104: 00010000:00010000:2.0:1787787211.667944:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: 00000000ada845b7/0xdeb1953cba4b0e15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0e1c expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787211.668291:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787787211.668298:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000346be051 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+3:6299:x1874630694407808:12345-0@lo:104: Request processed in 380us (8499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787211.668307:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787787211.669400:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787211.669413:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: 00000000ada845b7/0xdeb1953cba4b0e15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0e1c expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787211.669426:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ada845b7 already unused, calling callback (00000000ef0195c9) 10000000:00010000:3.0:1787787211.669483:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: 00000000ada845b7/0xdeb1953cba4b0e15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b0e1c expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787211.669502:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: 00000000ada845b7/0xdeb1953cba4b0e15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b0e1c expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787787211.669516:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: 00000000ada845b7/0xdeb1953cba4b0e15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b0e1c expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787211.669523:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787787211.669597:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: 00000000ada845b7/0xdeb1953cba4b0e15 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0e1c expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787211.669605:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787787211.669631:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: 00000000ada845b7/0xdeb1953cba4b0e15 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0e1c expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787211.669638:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: 00000000ada845b7/0xdeb1953cba4b0e15 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0e1c expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787211.669687:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787211.669689:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787211.669691:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787211.669926:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787787211.669951:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003183b50f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694407936:0@lo:103: 00000100:00100000:0.0:1787787211.670040:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787211.670109:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694407936 00000100:00100000:0.0:1787787211.670117:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694407936 00010000:00010000:0.0:1787787211.670152:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ecd1ba0f/0xdeb1953cba4b0e1c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0e15 expref: 12 pid: 5813 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787211.670197:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787787211.670207:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a04bb2c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1500c007-b35b-4004-b231-bb5a7ec082ef+12:3293:x1874630694407936:12345-0@lo:103: 00010000:00010000:0.0:1787787211.670222:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787211.670229:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ecd1ba0f/0xdeb1953cba4b0e1c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0e15 expref: 12 pid: 5813 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787211.670242:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ecd1ba0f/0xdeb1953cba4b0e1c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b0e15 expref: 12 pid: 5813 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787211.670265:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001b7f7570/0xdeb1953cba4b0e5b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787211.670274:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001b7f7570/0xdeb1953cba4b0e5b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787211.670290:0:5805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001b7f7570/0xdeb1953cba4b0e5b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787211.670305:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001b7f7570/0xdeb1953cba4b0e5b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787211.670311:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001b7f7570/0xdeb1953cba4b0e5b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787211.670316:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001b7f7570/0xdeb1953cba4b0e5b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787211.670322:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001b7f7570 already unused, calling callback (00000000aec634fb) 00010000:00010000:0.0:1787787211.670325:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001b7f7570/0xdeb1953cba4b0e5b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787211.670332:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001b7f7570/0xdeb1953cba4b0e5b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787211.670340:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001b7f7570/0xdeb1953cba4b0e5b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787211.670362:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787211.670399:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a04bb2c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1500c007-b35b-4004-b231-bb5a7ec082ef+12:3293:x1874630694407936:12345-0@lo:103: Request processed in 194us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787211.670407:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787787211.670473:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003183b50f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694407936:0@lo:103: 00010000:00010000:1.0:1787787211.676377:0:6299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ecd1ba0f/0xdeb1953cba4b0e1c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b0e15 expref: 11 pid: 5813 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787211.676407:0:6299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b175822 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6299:1874630694407808:0@lo:104: 00010000:00010000:1.0:1787787211.676462:0:6299:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001b7f7570/0xdeb1953cba4b0e5b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787211.678729:0:6299:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001b7f7570/0xdeb1953cba4b0e5b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787211.678753:0:6299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001b7f7570/0xdeb1953cba4b0e5b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787211.678791:0:6299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001b7f7570/0xdeb1953cba4b0e5b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787212.160331:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787787212.163777:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a5be4f05 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874630694408192:0@lo:400: 00000100:00100000:0.0:1787787212.163882:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787212.163951:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000023836fa8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694408064:0@lo:400: 00000100:00100000:0.0:1787787212.163983:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787212.164293:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694408192 00000100:00100000:0.0:1787787212.164302:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694408192 00000100:00100000:0.0:1787787212.164367:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787787212.164377:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000072c480c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1874630694408192:12345-0@lo:400: 00000100:00100000:0.0:1787787212.164462:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000072c480c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1874630694408192:12345-0@lo:400: Request processed in 87us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787212.164470:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787787212.164500:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694408064 00000100:00100000:0.0:1787787212.164504:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694408064 00000100:00100000:0.0:1787787212.164534:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787787212.164540:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004978b4a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+11:3292:x1874630694408064:12345-0@lo:400: 00000100:00100000:0.0:1787787212.164573:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004978b4a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+11:3292:x1874630694408064:12345-0@lo:400: Request processed in 33us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787212.164579:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1787787212.165388:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a5be4f05 x1874630694408192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787212.165410:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a5be4f05 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874630694408192:0@lo:400: 00000100:00100000:0.0:1787787212.165477:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000023836fa8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694408064:0@lo:400: 00010000:00010000:2.0:1787787212.413695:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787213.436691:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787214.464031:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787215.484604:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787216.508666:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787787216.933858:0:6670:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787787216.933861:0:6670:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787787216.933940:0:6670:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000007d005428 00000020:01000004:3.0:1787787216.933952:0:6670:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787787216.933960:0:6670:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787787216.933978:0:6670:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (000000001a9c235b) 00000020:00000080:3.0:1787787216.933993:0:6670:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787787216.956622:0:6670:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1787787216.956875:0:6670:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787787216.977271:0:6670:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787787216.986903:0:6670:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787787216.986936:0:6670:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787787216.987072:0:6670:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787787216.987096:0:6670:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787787216.987597:0:6670:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787787216.987606:0:6670:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787787216.987616:0:6670:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdeb1953cba4b0e69 00000020:01000004:2.0:1787787216.987623:0:6670:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787787216.987643:0:6670:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.110@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787787216.987646:0:6670:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.110@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787787216.987651:0:6670:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787787216.987655:0:6670:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787787216.987664:0:6670:0:(genops.c:413:class_newdev()) Allocate new device OSS (00000000b74a7022) 00000020:00000080:2.0:1787787216.987679:0:6670:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1787787216.988817:0:6670:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787787216.990315:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787787216.990334:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787787216.991600:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787787216.991608:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787787216.992213:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787787216.992220:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787787216.999027:0:6670:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787787216.999191:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787787216.999196:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787787216.999868:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787787216.999877:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787787217.024637:0:6670:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787787217.024864:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787787217.024870:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787787217.025961:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787787217.025972:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787787217.027358:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787787217.027369:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787787217.030000:0:6670:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787787217.030182:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787787217.030188:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787787217.030887:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787787217.030894:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787787217.089929:0:6670:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787787217.090575:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787787217.090581:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787787217.093651:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787787217.093666:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787787217.094556:0:6670:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787787217.094581:0:6670:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787787217.094586:0:6670:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.110@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787787217.115058:0:6670:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.110@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787787217.115086:0:6670:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.110@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1787787217.115089:0:6670:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787787217.115090:0:6670:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787787217.115091:0:6670:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787217.115092:0:6670:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787787217.115093:0:6670:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787217.115093:0:6670:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787217.115094:0:6670:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787787217.115095:0:6670:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787787217.115096:0:6670:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787787217.115097:0:6670:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787217.115098:0:6670:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787787217.115100:0:6670:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1787787217.115101:0:6670:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787787217.115102:0:6670:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787787217.115103:0:6670:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787217.115103:0:6670:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787787217.115104:0:6670:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787217.115104:0:6670:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787217.115105:0:6670:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787787217.115106:0:6670:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787787217.115109:0:6670:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787787217.115109:0:6670:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787217.115110:0:6670:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787787217.115131:0:6670:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787787217.115202:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000050161f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694408320:0@lo:253: 00000100:00100000:0.0:1787787217.115266:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787217.115328:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set 00000000939227d2 going to sleep for 11 seconds 00000100:00100000:2.0:1787787217.115425:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694408320 00000100:00100000:2.0:1787787217.115432:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694408320 00000100:00100000:2.0:1787787217.115499:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787787217.115506:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a8f95460 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+11:6670:x1874630694408320:12345-0@lo:253: 20000000:01000000:2.0:1787787217.115542:0:5812:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787787217.115546:0:5812:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1787787217.115550:0:5812:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1787787217.115553:0:5812:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1787787217.116532:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787787217.116752:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1787787217.116765:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1787787217.116805:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1787787217.116813:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1787787217.116845:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1787787217.116889:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1787787217.117477:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1787787217.117497:0:5812:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.110@tcp 20000000:01000000:2.0:1787787217.117499:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.110@tcp (null) (null) (null) 00000040:00080000:2.0:1787787217.117534:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1787787217.117542:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787787217.117707:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1787787217.117718:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.110@tcp (null) (null) 00000040:00080000:3.0:1787787217.117770:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1787787217.117780:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787787217.117811:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1787787217.117862:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1787787217.119106:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1787787217.119128:0:5812:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.110@tcp 20000000:01000000:3.0:1787787217.120548:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.110@tcp (null) (null) (null) 00000040:00080000:3.0:1787787217.120628:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1787787217.120641:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787787217.120675:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1787787217.120683:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.110@tcp (null) (null) 00000040:00080000:3.0:1787787217.120758:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1787787217.120770:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787787217.120805:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1787787217.120840:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1787787217.120857:0:5812:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787787217.120860:0:5812:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787787217.120863:0:5812:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787787217.120873:0:5812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787787217.120876:0:5812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787787217.120909:0:5812:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787787217.120912:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787787217.123875:0:6685:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1787787217.123964:0:6685:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1787787217.124021:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1787787217.124751:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1787787217.124796:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1787787217.124859:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1787787217.124874:0:5812:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787787217.124876:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787787217.126101:0:6686:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1787787217.126278:0:6686:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1787787217.126744:0:6686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1787787217.127086:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1787787217.127145:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1787787217.127395:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1787787217.127676:0:5812:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787787217.127679:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787787217.129026:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1787787217.129754:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1787787217.129802:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1787787217.129871:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1787787217.129888:0:5812:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1787787217.129891:0:5812:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1787787217.129899:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787787217.129915:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006e58fc8e/0xdeb1953cba4b0e77 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.129934:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000010336e68/0xdeb1953cba4b0d9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0d97 expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.129941:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000058f73ea9/0xdeb1953cba4b0dba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0db3 expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.129947:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000678d735f/0xdeb1953cba4b0e2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0e23 expref: 11 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.129955:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006e58fc8e/0xdeb1953cba4b0e77 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.129989:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000678d735f/0xdeb1953cba4b0e2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b0e23 expref: 11 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.130003:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000678d735f/0xdeb1953cba4b0e2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b0e23 expref: 11 pid: 5814 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787217.130017:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008dc437d4 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5812:1874630694408448:0@lo:104: 00000100:00100000:2.0:1787787217.130085:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787787217.130194:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000058f73ea9/0xdeb1953cba4b0dba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b0db3 expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.130354:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000058f73ea9/0xdeb1953cba4b0dba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b0db3 expref: 11 pid: 5812 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787217.130364:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000077617f2b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5812:1874630694408576:0@lo:104: 00000100:00100000:2.0:1787787217.130412:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787787217.130843:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000010336e68/0xdeb1953cba4b0d9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b0d97 expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.130853:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000010336e68/0xdeb1953cba4b0d9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b0d97 expref: 11 pid: 5813 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787217.130860:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000677bf4ae pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5812:1874630694408704:0@lo:104: 00000100:00100000:2.0:1787787217.130900:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787217.130984:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694408448 00000100:00100000:0.0:1787787217.130991:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694408448 00000100:00100000:2.0:1787787217.131045:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 00000000abaf8610 going to sleep for 11 seconds 00000100:00100000:1.0:1787787217.131083:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694408576 00000100:00100000:1.0:1787787217.131088:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694408576 00000100:00100000:1.0:1787787217.131125:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694408704 00000100:00100000:1.0:1787787217.131127:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694408704 00000100:00100000:1.0:1787787217.131150:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787787217.131156:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df59778a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+5:5812:x1874630694408576:12345-0@lo:104: 00010000:00010000:1.0:1787787217.131368:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: 00000000092e1fcc/0xdeb1953cba4b0db3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0dba expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.137948:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787787217.137964:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df59778a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+5:5812:x1874630694408576:12345-0@lo:104: Request processed in 6804us (7558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787217.137977:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787787217.138010:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787787217.138022:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002676c95f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+4:5812:x1874630694408704:12345-0@lo:104: 00010000:00010000:1.0:1787787217.138037:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: 000000007cfc2a3d/0xdeb1953cba4b0d97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0d9e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.138077:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787787217.138082:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002676c95f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+4:5812:x1874630694408704:12345-0@lo:104: Request processed in 67us (7182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787217.138088:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787787217.138100:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787787217.138107:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6d48bd3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+3:5812:x1874630694408448:12345-0@lo:104: 00010000:00010000:1.0:1787787217.138114:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: 000000002ee10275/0xdeb1953cba4b0e23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0e2a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.138139:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787787217.138144:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6d48bd3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+3:5812:x1874630694408448:12345-0@lo:104: Request processed in 39us (8060us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787217.138150:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1787787217.138190:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787787217.138206:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: 00000000092e1fcc/0xdeb1953cba4b0db3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0dba expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.138213:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000092e1fcc already unused, calling callback (00000000ef0195c9) 10000000:00010000:1.0:1787787217.138216:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: 00000000092e1fcc/0xdeb1953cba4b0db3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b0dba expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.138222:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: 00000000092e1fcc/0xdeb1953cba4b0db3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b0dba expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787217.138227:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: 00000000092e1fcc/0xdeb1953cba4b0db3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b0dba expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787217.138233:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787787217.138266:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: 00000000092e1fcc/0xdeb1953cba4b0db3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0dba expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.138272:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787217.138289:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: 00000000092e1fcc/0xdeb1953cba4b0db3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0dba expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.138305:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: 00000000092e1fcc/0xdeb1953cba4b0db3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0dba expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.138334:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787787217.138337:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: 000000007cfc2a3d/0xdeb1953cba4b0d97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0d9e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.138342:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007cfc2a3d already unused, calling callback (00000000ef0195c9) 10000000:00010000:1.0:1787787217.138344:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: 000000007cfc2a3d/0xdeb1953cba4b0d97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b0d9e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.138361:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: 000000007cfc2a3d/0xdeb1953cba4b0d97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b0d9e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787217.138367:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: 000000007cfc2a3d/0xdeb1953cba4b0d97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b0d9e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787217.138372:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787787217.138395:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: 000000007cfc2a3d/0xdeb1953cba4b0d97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0d9e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.138409:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787217.138413:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: 000000007cfc2a3d/0xdeb1953cba4b0d97 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0d9e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.138420:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: 000000007cfc2a3d/0xdeb1953cba4b0d97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0d9e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.138432:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787217.138434:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: 000000002ee10275/0xdeb1953cba4b0e23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0e2a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.138456:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002ee10275 already unused, calling callback (00000000ef0195c9) 10000000:00010000:1.0:1787787217.138458:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: 000000002ee10275/0xdeb1953cba4b0e23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b0e2a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.138464:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: 000000002ee10275/0xdeb1953cba4b0e23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b0e2a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787217.138470:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: 000000002ee10275/0xdeb1953cba4b0e23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b0e2a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787217.138481:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787787217.138493:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: 000000002ee10275/0xdeb1953cba4b0e23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0e2a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.138499:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787217.138513:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: 000000002ee10275/0xdeb1953cba4b0e23 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0e2a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.138519:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: 000000002ee10275/0xdeb1953cba4b0e23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0e2a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.138534:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787217.138536:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787217.138537:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787217.138543:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787217.138561:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000035a37687 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694408832:0@lo:103: 00000100:00100000:1.0:1787787217.139124:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787217.139221:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787787217.139228:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b4e08d83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694408960:0@lo:103: 00000100:00100000:1.0:1787787217.139254:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787217.139360:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000669aa25d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694409088:0@lo:103: 00000100:00100000:1.0:1787787217.139539:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787217.139660:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694408832 00000100:00100000:1.0:1787787217.139668:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694408832 00010000:00010000:1.0:1787787217.139710:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000058f73ea9/0xdeb1953cba4b0dba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0db3 expref: 12 pid: 5812 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787217.139730:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694408960 00000100:00100000:1.0:1787787217.139739:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694408960 00010000:00010000:1.0:1787787217.139752:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000010336e68/0xdeb1953cba4b0d9e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0d97 expref: 13 pid: 5813 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787217.139764:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694409088 00000100:00100000:1.0:1787787217.139767:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694409088 00010000:00010000:1.0:1787787217.139790:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000678d735f/0xdeb1953cba4b0e2a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0e23 expref: 14 pid: 5814 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787217.139805:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787787217.139813:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed347938 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+14:3293:x1874630694408832:12345-0@lo:103: 00010000:00010000:1.0:1787787217.139825:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787217.139829:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000058f73ea9/0xdeb1953cba4b0dba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0db3 expref: 14 pid: 5812 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.139838:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000058f73ea9/0xdeb1953cba4b0dba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b0db3 expref: 14 pid: 5812 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.139856:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787217.139888:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed347938 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+14:3293:x1874630694408832:12345-0@lo:103: Request processed in 78us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787217.139895:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787787217.139911:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787787217.139916:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b7cde1a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+13:3293:x1874630694408960:12345-0@lo:103: 00010000:00010000:1.0:1787787217.139924:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787217.139927:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000010336e68/0xdeb1953cba4b0d9e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0d97 expref: 13 pid: 5813 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.139935:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000010336e68/0xdeb1953cba4b0d9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b0d97 expref: 13 pid: 5813 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.139956:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787217.139979:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b7cde1a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+13:3293:x1874630694408960:12345-0@lo:103: Request processed in 63us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787217.139985:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787787217.139998:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787787217.140004:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000243b924b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+12:3291:x1874630694409088:12345-0@lo:103: 00010000:00010000:1.0:1787787217.140011:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787217.140014:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000678d735f/0xdeb1953cba4b0e2a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0e23 expref: 12 pid: 5814 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.140023:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000678d735f/0xdeb1953cba4b0e2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b0e23 expref: 12 pid: 5814 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.140033:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006e58fc8e/0xdeb1953cba4b0e77 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.140039:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006e58fc8e/0xdeb1953cba4b0e77 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.140052:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006e58fc8e/0xdeb1953cba4b0e77 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.140058:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006e58fc8e/0xdeb1953cba4b0e77 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.140064:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006e58fc8e/0xdeb1953cba4b0e77 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.140070:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006e58fc8e/0xdeb1953cba4b0e77 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.140081:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006e58fc8e already unused, calling callback (00000000aec634fb) 00010000:00010000:1.0:1787787217.140084:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006e58fc8e/0xdeb1953cba4b0e77 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.140091:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006e58fc8e/0xdeb1953cba4b0e77 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.140099:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006e58fc8e/0xdeb1953cba4b0e77 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.140112:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787217.140136:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000243b924b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+12:3291:x1874630694409088:12345-0@lo:103: Request processed in 133us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787217.140142:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787787217.141075:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b4e08d83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694408960:0@lo:103: 00000100:00100000:1.0:1787787217.141086:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000035a37687 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694408832:0@lo:103: 00000100:00100000:1.0:1787787217.141115:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000669aa25d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694409088:0@lo:103: 00010000:00010000:0.0:1787787217.141733:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000058f73ea9/0xdeb1953cba4b0dba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b0db3 expref: 11 pid: 5812 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787217.141749:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000077617f2b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5812:1874630694408576:0@lo:104: 00010000:00010000:0.0:1787787217.141762:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000010336e68/0xdeb1953cba4b0d9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b0d97 expref: 10 pid: 5813 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787217.141769:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000677bf4ae pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5812:1874630694408704:0@lo:104: 00010000:00010000:0.0:1787787217.141777:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000678d735f/0xdeb1953cba4b0e2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b0e23 expref: 9 pid: 5814 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787217.141785:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008dc437d4 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5812:1874630694408448:0@lo:104: 00010000:00010000:0.0:1787787217.141805:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006e58fc8e/0xdeb1953cba4b0e77 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.141812:0:5812:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006e58fc8e/0xdeb1953cba4b0e77 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.141834:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006e58fc8e/0xdeb1953cba4b0e77 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.141839:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006e58fc8e/0xdeb1953cba4b0e77 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787787217.141851:0:5812:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787787217.207261:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a8f95460 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+8:6670:x1874630694408320:12345-0@lo:253: Request processed in 91749us (91988us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787217.207275:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787787217.209997:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000050161f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694408320:0@lo:253: 10000000:01000000:0.0:1787787217.210018:0:6670:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787787217.210021:0:6670:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787787217.210023:0:6670:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787787217.210024:0:6670:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787217.210025:0:6670:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1787787217.210026:0:6670:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787217.210027:0:6670:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787217.210028:0:6670:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787787217.210030:0:6670:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787787217.210032:0:6670:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787217.210033:0:6670:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787787217.210059:0:6670:0:(tgt_mount.c:101:server_register_mount()) register mount 000000007d005428 from lustre-OST0000 10000000:01000000:1.0:1787787217.210334:0:6670:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787787217.210338:0:6670:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787787217.210345:0:6670:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d0703128000 local copy 10000000:01000000:1.0:1787787217.210349:0:6670:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787787217.210383:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: 000000002ee10275/0xdeb1953cba4b0e7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.210394:0:6670:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.110@tcp lock: 000000002ee10275/0xdeb1953cba4b0e7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.211038:0:6670:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: 000000002ee10275/0xdeb1953cba4b0e7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787217.211073:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000669aa25d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694409216:0@lo:101: 00000100:00100000:1.0:1787787217.211126:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787217.211382:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694409216 00000100:00100000:0.0:1787787217.211389:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694409216 00000100:00100000:0.0:1787787217.211458:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787787217.211466:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d49b6f34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+8:6670:x1874630694409216:12345-0@lo:101: 00010000:00010000:0.0:1787787217.211478:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787217.211491:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000678d735f/0xdeb1953cba4b0e85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b0e7e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.211512:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000678d735f/0xdeb1953cba4b0e85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b0e7e expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.211531:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000678d735f/0xdeb1953cba4b0e85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0e7e expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.211539:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000678d735f, rc 0) 00000100:00100000:0.0:1787787217.211570:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d49b6f34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+9:6670:x1874630694409216:12345-0@lo:101: Request processed in 106us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787217.211577:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787787217.211642:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b0467cc5 going to sleep for 11 seconds 00000100:00100000:1.0:1787787217.211658:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000669aa25d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694409216:0@lo:101: 00010000:00010000:1.0:1787787217.211677:0:6670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: 000000002ee10275/0xdeb1953cba4b0e7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdeb1953cba4b0e85 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.211685:0:6670:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: 000000002ee10275/0xdeb1953cba4b0e7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdeb1953cba4b0e85 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787217.211782:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000669aa25d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694409344:0@lo:501: 00000100:00100000:1.0:1787787217.211805:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787217.211865:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694409344 00000100:00100000:2.0:1787787217.211871:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694409344 00000100:00100000:2.0:1787787217.211908:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787787217.211914:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000892ad97f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+9:6670:x1874630694409344:12345-0@lo:501: 00000100:00100000:2.0:1787787217.212095:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000892ad97f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+9:6670:x1874630694409344:12345-0@lo:501: Request processed in 181us (289us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787787217.212103:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787787217.215535:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b0467cc5 going to sleep for 11 seconds 00000100:00100000:1.0:1787787217.215573:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000669aa25d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694409344:0@lo:501: 10000000:01000000:1.0:1787787217.215607:0:6670:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.110@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787787217.215657:0:6670:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.110@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787787217.215663:0:6670:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: 000000002ee10275/0xdeb1953cba4b0e7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdeb1953cba4b0e85 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.215673:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: 000000002ee10275/0xdeb1953cba4b0e7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdeb1953cba4b0e85 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.215679:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: 000000002ee10275/0xdeb1953cba4b0e7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdeb1953cba4b0e85 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.215704:0:6670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787787217.215742:0:6670:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d0707278800 10000000:01000000:1.0:1787787217.215747:0:6670:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787787217.215752:0:6670:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9d0703128000 10000000:01000000:1.0:1787787217.215754:0:6670:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787787217.215758:0:6670:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9d0703128000 from 1 10000000:01000000:1.0:1787787217.215760:0:6670:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787787217.215785:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787217.215788:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: 00000000b129cd9e/0xdeb1953cba4b0e8c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.215800:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: 000000002ee10275/0xdeb1953cba4b0e7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xdeb1953cba4b0e85 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.215800:0:6670:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: 00000000b129cd9e/0xdeb1953cba4b0e8c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.215819:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002ee10275 already unused, calling callback (00000000ef0195c9) 00010000:00010000:1.0:1787787217.215822:0:6670:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: 00000000b129cd9e/0xdeb1953cba4b0e8c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787217.215823:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: 000000002ee10275/0xdeb1953cba4b0e7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xdeb1953cba4b0e85 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.215840:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: 000000002ee10275/0xdeb1953cba4b0e7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xdeb1953cba4b0e85 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787217.215848:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: 000000002ee10275/0xdeb1953cba4b0e7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xdeb1953cba4b0e85 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787217.215852:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000669aa25d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694409472:0@lo:101: 10000000:01000000:2.0:1787787217.215863:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787787217.215884:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: 000000002ee10275/0xdeb1953cba4b0e7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdeb1953cba4b0e85 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.215891:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787787217.215908:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787217.215936:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set 000000006ca05cfc going to sleep for 11 seconds 00010000:00010000:2.0:1787787217.215970:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: 000000002ee10275/0xdeb1953cba4b0e7e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdeb1953cba4b0e85 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.215979:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: 000000002ee10275/0xdeb1953cba4b0e7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdeb1953cba4b0e85 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.215996:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787217.215998:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787217.215999:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787217.216013:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694409472 00000100:00100000:2.0:1787787217.216018:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694409472 00000100:00100000:3.0:1787787217.216047:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787787217.216060:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bcbeff6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694409600:0@lo:103: 00000100:00100000:2.0:1787787217.216066:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787787217.216075:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002074d4fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+9:6670:x1874630694409472:12345-0@lo:101: 00000100:00100000:3.0:1787787217.216092:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787787217.216094:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787217.216107:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005ae7d248/0xdeb1953cba4b0e93 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b0e8c expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.216127:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005ae7d248/0xdeb1953cba4b0e93 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b0e8c expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.216136:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005ae7d248/0xdeb1953cba4b0e93 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0e8c expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.216150:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005ae7d248, rc 0) 00000100:00100000:2.0:1787787217.216193:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002074d4fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+10:6670:x1874630694409472:12345-0@lo:101: Request processed in 120us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787217.216199:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787787217.216294:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000669aa25d pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694409472:0@lo:101: 00010000:00010000:3.0:1787787217.216307:0:6670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: 00000000b129cd9e/0xdeb1953cba4b0e8c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0e93 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787217.216335:0:6670:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: 00000000b129cd9e/0xdeb1953cba4b0e8c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b0e93 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787217.216352:0:6670:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787787217.216367:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: 00000000b129cd9e/0xdeb1953cba4b0e8c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0e93 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787217.216373:0:6670:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: 00000000b129cd9e/0xdeb1953cba4b0e8c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0e93 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787217.216380:0:6670:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787787217.216383:0:6670:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787787217.216388:0:6670:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787787217.216390:0:6670:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787787217.216484:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: 0000000043aae460/0xdeb1953cba4b0e9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787217.216491:0:6670:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: 0000000043aae460/0xdeb1953cba4b0e9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787217.216498:0:6670:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: 0000000043aae460/0xdeb1953cba4b0e9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787217.216510:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009991aeae pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694409728:0@lo:101: 00000100:00100000:3.0:1787787217.216535:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787217.216553:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set 0000000007c7cfe2 going to sleep for 11 seconds 00000100:00100000:0.0:1787787217.216626:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694409728 00000100:00100000:0.0:1787787217.216631:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694409728 00000100:00100000:0.0:1787787217.216660:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787787217.216665:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0355283 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+10:6670:x1874630694409728:12345-0@lo:101: 00010000:00010000:0.0:1787787217.216672:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787217.216680:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004a38cfd7/0xdeb1953cba4b0ea1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b0e9a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.216693:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004a38cfd7/0xdeb1953cba4b0ea1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b0e9a expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.216700:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004a38cfd7/0xdeb1953cba4b0ea1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0e9a expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.216707:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004a38cfd7, rc 0) 00000100:00100000:0.0:1787787217.216735:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0355283 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+11:6670:x1874630694409728:12345-0@lo:101: Request processed in 70us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787217.216741:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787787217.216821:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009991aeae pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694409728:0@lo:101: 00010000:00010000:3.0:1787787217.216831:0:6670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: 0000000043aae460/0xdeb1953cba4b0e9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0ea1 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787217.216843:0:6670:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: 0000000043aae460/0xdeb1953cba4b0e9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b0ea1 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787217.216913:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009991aeae pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694409856:0@lo:501: 00000100:00100000:3.0:1787787217.216936:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787217.216957:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set 0000000007c7cfe2 going to sleep for 11 seconds 00000100:00100000:0.0:1787787217.217067:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694409856 00000100:00100000:0.0:1787787217.217071:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694409856 00000100:00100000:0.0:1787787217.217099:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787787217.217110:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000894b1ac6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+11:6670:x1874630694409856:12345-0@lo:501: 00000100:00100000:1.0:1787787217.217300:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694409600 00000100:00100000:1.0:1787787217.217304:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694409600 00000100:00100000:0.0:1787787217.217553:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000894b1ac6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+12:6670:x1874630694409856:12345-0@lo:501: Request processed in 443us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787217.217560:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787787217.217769:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787787217.217778:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f947a7a6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+11:3291:x1874630694409600:12345-0@lo:103: 00010000:00010000:1.0:1787787217.217788:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787217.217801:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000678d735f/0xdeb1953cba4b0e85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdeb1953cba4b0e7e expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.217828:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787217.217884:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f947a7a6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+10:3291:x1874630694409600:12345-0@lo:103: Request processed in 108us (1792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787217.217890:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787787217.217956:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bcbeff6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694409600:0@lo:103: 00000100:00100000:3.0:1787787217.219472:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009991aeae pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694409856:0@lo:501: 00000100:00100000:3.0:1787787217.219521:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009991aeae pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694409984:0@lo:503: 00000100:00100000:3.0:1787787217.219577:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787217.219602:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set 0000000007c7cfe2 going to sleep for 11 seconds 00000100:00100000:1.0:1787787217.219742:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694409984 00000100:00100000:1.0:1787787217.219748:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694409984 00000100:00100000:1.0:1787787217.219786:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787787217.219793:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044b824cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+10:6670:x1874630694409984:12345-0@lo:503: 00000100:00100000:1.0:1787787217.219980:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044b824cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+10:6670:x1874630694409984:12345-0@lo:503: Request processed in 187us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787217.219987:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787787217.220110:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009991aeae pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694409984:0@lo:503: 00000040:00080000:3.0:1787787217.220417:0:6670:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787787217.220664:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009991aeae pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694410112:0@lo:502: 00000100:00100000:3.0:1787787217.220702:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787217.220766:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set 0000000007c7cfe2 going to sleep for 11 seconds 00000100:00100000:1.0:1787787217.221193:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694410112 00000100:00100000:1.0:1787787217.221200:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694410112 00000100:00100000:1.0:1787787217.221238:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787787217.221245:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000652b4da9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+10:6670:x1874630694410112:12345-0@lo:502: 00000100:00100000:1.0:1787787217.221537:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000652b4da9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+10:6670:x1874630694410112:12345-0@lo:502: Request processed in 292us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787217.221544:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787787217.221660:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009991aeae pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694410112:0@lo:502: 00000040:00080000:3.0:1787787217.221912:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787787217.221959:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787787217.221994:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787787217.222043:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787787217.222080:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787787217.222115:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787787217.222142:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009991aeae pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694410240:0@lo:502: 00000100:00100000:3.0:1787787217.222182:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787217.222272:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set 0000000007c7cfe2 going to sleep for 11 seconds 00000100:00100000:0.0:1787787217.222514:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694410240 00000100:00100000:0.0:1787787217.222521:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694410240 00000100:00100000:0.0:1787787217.222550:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787787217.222556:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d67529ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+10:6670:x1874630694410240:12345-0@lo:502: 00000100:00100000:0.0:1787787217.222822:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d67529ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+10:6670:x1874630694410240:12345-0@lo:502: Request processed in 265us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787217.222828:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787787217.222899:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009991aeae pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694410240:0@lo:502: 00000040:00080000:3.0:1787787217.223034:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787787217.223044:0:6670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1787787217.223647:0:6688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787787217.223655:0:6688:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787787217.223662:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787217.223664:0:6688:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787787217.223669:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787787217.223680:0:6688:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (0000000075b95d7a) 00000020:00000080:0.0:1787787217.223697:0:6688:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787787217.223703:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787787217.223774:0:6688:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007d005428 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787787217.223781:0:6688:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787787217.223787:0:6688:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdeb1953cba4b0eaf 00010000:00010000:0.0:1787787217.230907:0:6688:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1787787217.231267:0:6688:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1787787217.237925:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787787217.238356:0:6688:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1787787217.252276:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787787217.253670:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787787217.256172:0:6688:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787787217.256183:0:6688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787787217.256189:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787217.256191:0:6688:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787787217.256194:0:6688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787787217.256198:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787217.256199:0:6688:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787787217.256202:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787787217.256203:0:6688:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787787217.256251:0:6688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787787217.256254:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787217.256256:0:6688:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787787217.256258:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787787217.258817:0:6670:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1787787217.258964:0:6670:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787787217.259026:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: 0000000043aae460/0xdeb1953cba4b0e9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0ea1 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787217.259039:0:6670:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: 0000000043aae460/0xdeb1953cba4b0e9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0ea1 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787217.259047:0:6670:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d0707278800 from 1 10000000:01000000:3.0:1787787217.259049:0:6670:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787787217.259084:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: 00000000693dec2f/0xdeb1953cba4b0eb6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787217.259091:0:6670:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: 00000000693dec2f/0xdeb1953cba4b0eb6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787217.259100:0:6670:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: 00000000693dec2f/0xdeb1953cba4b0eb6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787217.259123:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009991aeae pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694410368:0@lo:101: 00000100:00100000:3.0:1787787217.259190:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787217.259233:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set 0000000007c7cfe2 going to sleep for 11 seconds 00000100:00100000:1.0:1787787217.259294:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694410368 00000100:00100000:1.0:1787787217.259301:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694410368 00000100:00100000:1.0:1787787217.259375:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787787217.259393:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007cc3ca10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+10:6670:x1874630694410368:12345-0@lo:101: 00010000:00010000:1.0:1787787217.259406:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787217.259418:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f591b664/0xdeb1953cba4b0ebd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b0eb6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.259465:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f591b664/0xdeb1953cba4b0ebd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b0eb6 expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.259475:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f591b664/0xdeb1953cba4b0ebd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0eb6 expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.259483:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f591b664, rc 0) 00000100:00100000:1.0:1787787217.259537:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007cc3ca10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+11:6670:x1874630694410368:12345-0@lo:101: Request processed in 146us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787217.259544:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787787217.260000:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009991aeae pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694410368:0@lo:101: 00010000:00010000:2.0:1787787217.260025:0:6670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: 00000000693dec2f/0xdeb1953cba4b0eb6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0ebd expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.260033:0:6670:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: 00000000693dec2f/0xdeb1953cba4b0eb6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b0ebd expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787217.260134:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000011f6ce0a pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694410496:0@lo:501: 00000100:00100000:2.0:1787787217.260165:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787217.260195:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cd1f7ab3 going to sleep for 11 seconds 00000100:00100000:1.0:1787787217.260481:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694410496 00000100:00100000:1.0:1787787217.260487:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694410496 00000100:00100000:1.0:1787787217.260518:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787787217.260524:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f382397 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+11:6670:x1874630694410496:12345-0@lo:501: 00000100:00100000:1.0:1787787217.261662:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f382397 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+11:6670:x1874630694410496:12345-0@lo:501: Request processed in 1134us (1492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787217.261673:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787787217.261795:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000011f6ce0a pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694410496:0@lo:501: 00000100:00100000:2.0:1787787217.261957:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000011f6ce0a pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694410624:0@lo:503: 00000100:00100000:2.0:1787787217.262641:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787217.262667:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cd1f7ab3 going to sleep for 11 seconds 00000100:00100000:3.0:1787787217.262674:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694410624 00000100:00100000:3.0:1787787217.262680:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694410624 00000100:00100000:3.0:1787787217.262722:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787787217.262730:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da873709 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+11:6670:x1874630694410624:12345-0@lo:503: 00000100:00100000:3.0:1787787217.263176:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da873709 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+11:6670:x1874630694410624:12345-0@lo:503: Request processed in 446us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787217.263189:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787787217.263378:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000011f6ce0a pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694410624:0@lo:503: 00000040:00080000:2.0:1787787217.263793:0:6670:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787787217.263851:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000011f6ce0a pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694410752:0@lo:502: 00000100:00100000:2.0:1787787217.263961:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787217.263992:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cd1f7ab3 going to sleep for 11 seconds 00000100:00100000:0.0:1787787217.264069:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694410752 00000100:00100000:0.0:1787787217.264074:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694410752 00000100:00100000:0.0:1787787217.264114:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787787217.264121:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b55c842c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+11:6670:x1874630694410752:12345-0@lo:502: 00000100:00100000:0.0:1787787217.264427:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b55c842c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+11:6670:x1874630694410752:12345-0@lo:502: Request processed in 307us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787217.264435:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787787217.264615:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000011f6ce0a pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694410752:0@lo:502: 00000040:00080000:2.0:1787787217.264952:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787787217.265004:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787787217.265028:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000011f6ce0a pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694410880:0@lo:502: 00000100:00100000:2.0:1787787217.265063:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787217.265091:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cd1f7ab3 going to sleep for 11 seconds 00000100:00100000:3.0:1787787217.265205:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694410880 00000100:00100000:3.0:1787787217.265210:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694410880 00000100:00100000:3.0:1787787217.265243:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787787217.265250:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000170b5da2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+11:6670:x1874630694410880:12345-0@lo:502: 00000100:00100000:3.0:1787787217.265649:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000170b5da2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+11:6670:x1874630694410880:12345-0@lo:502: Request processed in 400us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787217.265656:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787787217.266183:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000011f6ce0a pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694410880:0@lo:502: 00000040:00080000:2.0:1787787217.266314:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787787217.266337:0:6670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787787217.267101:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787217.267111:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787217.267113:0:6692:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787787217.267119:0:6692:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d0707278800 00000020:00000080:0.0:1787787217.267122:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787787217.267156:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787217.267159:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787217.267161:0:6692:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787787217.267163:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787787217.267339:0:6670:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787787217.267360:0:6670:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787787217.268180:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d070141fe00/0xdeb1953cba4b0eb6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0ebd expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.268196:0:6670:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d070141fe00/0xdeb1953cba4b0eb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0ebd expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787217.268249:0:6670:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787787217.268252:0:6670:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d0707278800 10000000:01000000:2.0:1787787217.268255:0:6670:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d0707278800 10000000:01000000:2.0:1787787217.268260:0:6670:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787787217.268266:0:6670:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d0707278800 from 1 10000000:01000000:2.0:1787787217.268269:0:6670:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787787217.268301:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0701646e00/0xdeb1953cba4b0ec4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.268309:0:6670:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d0701646e00/0xdeb1953cba4b0ec4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.268331:0:6670:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d0701646e00/0xdeb1953cba4b0ec4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787217.268352:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b122d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694411008:0@lo:101: 00000100:00100000:2.0:1787787217.268411:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787217.268474:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070595c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787217.268527:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694411008 00000100:00100000:0.0:1787787217.268534:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694411008 00000100:00100000:0.0:1787787217.268578:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787787217.268587:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703093050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+11:6670:x1874630694411008:12345-0@lo:101: 00010000:00010000:0.0:1787787217.268599:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787217.268611:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0700031c00/0xdeb1953cba4b0ecb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b0ec4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.268631:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0700031c00/0xdeb1953cba4b0ecb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b0ec4 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.268642:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0700031c00/0xdeb1953cba4b0ecb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0ec4 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.268650:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0700031c00, rc 0) 00000100:00100000:0.0:1787787217.268743:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703093050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+12:6670:x1874630694411008:12345-0@lo:101: Request processed in 156us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787217.268762:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787787217.269592:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b122d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694411008:0@lo:101: 00010000:00010000:3.0:1787787217.269609:0:6670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d0701646e00/0xdeb1953cba4b0ec4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0ecb expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787217.269618:0:6670:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d0701646e00/0xdeb1953cba4b0ec4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b0ecb expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787217.269726:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07222a3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694411136:0@lo:501: 00000100:00100000:3.0:1787787217.269761:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787217.269824:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07059c5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787787217.270681:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694411136 00000100:00100000:0.0:1787787217.270690:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694411136 00000100:00100000:0.0:1787787217.270820:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787787217.270829:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+12:6670:x1874630694411136:12345-0@lo:501: 00000100:00100000:0.0:1787787217.271683:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+12:6670:x1874630694411136:12345-0@lo:501: Request processed in 852us (1918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787217.271692:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787787217.273266:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07222a3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694411136:0@lo:501: 00000100:00100000:3.0:1787787217.273333:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07222a3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694411264:0@lo:503: 00000100:00100000:3.0:1787787217.273398:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787217.273648:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07059c5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787787217.273697:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694411264 00000100:00100000:0.0:1787787217.273703:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694411264 00000100:00100000:0.0:1787787217.273785:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787787217.273795:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+12:6670:x1874630694411264:12345-0@lo:503: 00000100:00100000:0.0:1787787217.273982:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+12:6670:x1874630694411264:12345-0@lo:503: Request processed in 188us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787217.273990:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787787217.274066:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07222a3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694411264:0@lo:503: 00000040:00080000:2.0:1787787217.274352:0:6670:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787787217.274414:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b121a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694411392:0@lo:502: 00000100:00100000:2.0:1787787217.274487:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787217.274932:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070595c240 going to sleep for 11 seconds 00000100:00100000:3.0:1787787217.275019:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694411392 00000100:00100000:3.0:1787787217.275025:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694411392 00000100:00100000:3.0:1787787217.275059:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787787217.275067:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+12:6670:x1874630694411392:12345-0@lo:502: 00000100:00100000:3.0:1787787217.275248:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+12:6670:x1874630694411392:12345-0@lo:502: Request processed in 181us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787217.275256:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787787217.275391:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b121a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694411392:0@lo:502: 00000040:00080000:2.0:1787787217.275699:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787787217.275761:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787787217.275800:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787787217.275849:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787787217.275999:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787787217.276127:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787787217.276169:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787787217.276207:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787787217.276261:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787787217.276299:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787787217.276347:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787787217.276412:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787787217.276510:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787787217.276947:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787787217.277001:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787787217.277248:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787787217.277290:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787787217.277355:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787787217.277394:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787787217.277429:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000100:00100000:0.0:1787787217.277601:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07222a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874630694411520:0@lo:400: 00000100:00100000:0.0:1787787217.277659:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787217.277748:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694411520 00000100:00100000:3.0:1787787217.277754:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694411520 00000100:00100000:3.0:1787787217.277799:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787787217.277808:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874630694411520:12345-0@lo:400: 00000100:00100000:3.0:1787787217.277916:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874630694411520:12345-0@lo:400: Request processed in 52us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787217.277925:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787787217.277965:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d07222a21c0 x1874630694411520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787217.277979:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07222a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874630694411520:0@lo:400: 00000040:00080000:2.0:1787787217.278709:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787787217.278755:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787787217.278793:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787787217.278940:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787787217.278988:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787787217.279045:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787787217.279097:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787787217.279153:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1787787217.279190:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b121a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694411648:0@lo:502: 00000100:00100000:2.0:1787787217.279245:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787217.282127:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070595c240 going to sleep for 11 seconds 00000100:00100000:3.0:1787787217.282174:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694411648 00000100:00100000:3.0:1787787217.282184:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694411648 00000100:00100000:3.0:1787787217.282276:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787787217.282286:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703092050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+12:6670:x1874630694411648:12345-0@lo:502: 00000100:00100000:3.0:1787787217.282710:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703092050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+12:6670:x1874630694411648:12345-0@lo:502: Request processed in 424us (3464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787217.282718:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787787217.282813:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b121a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694411648:0@lo:502: 00000040:00080000:2.0:1787787217.282933:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787787217.282947:0:6670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1787787217.283286:0:6693:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787787217.283301:0:6693:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9d07031299b8) 00000020:00000080:2.0:1787787217.283328:0:6693:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1787787217.283392:0:6693:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d0707278800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787787217.283396:0:6693:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d0707278800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787787217.283398:0:6693:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d0707278800 3 00010000:00080000:2.0:1787787217.283456:0:6693:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d073763d000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.110@tcp at head 00010000:00010000:2.0:1787787217.288163:0:6693:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1787787217.289411:0:6693:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787787217.289536:0:6693:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787787217.289548:0:6693:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xdeb1953cba4b0ed9 00000100:00080000:2.0:1787787217.289557:0:6693:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787787217.289563:0:6693:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d073763d000 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:2.0:1787787217.289593:0:6693:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d071b121a40 x1874630694411776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787787217.289716:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b121a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3290:1874630694411776:0@lo:38: 00000100:00080000:2.0:1787787217.289822:0:6693:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787787217.290006:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787217.290148:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694411776 00000100:00100000:2.0:1787787217.290154:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694411776 00000100:00100000:2.0:1787787217.290190:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787787217.290197:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07222a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3290:x1874630694411776:12345-0@lo:38: 00010000:00080000:2.0:1787787217.290218:0:5821:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 129 last 0 00000020:00000080:2.0:1787787217.290275:0:5821:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xdeb1953cba4b0ee0 00000004:00100000:2.0:1787787217.290289:0:5821:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787787217.290328:0:5821:0:(import.c:65:import_set_state_nolock()) ffff9d073763e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787217.290379:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07222a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1874630694411776:12345-0@lo:38: Request processed in 181us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787217.290387:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787787217.290427:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d071b121a40 x1874630694411776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787787227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787217.290465:0:3290:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787787217.290487:0:3290:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787787217.290494:0:3290:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787787217.290498:0:3290:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787787217.290500:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9d073763d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787787217.290506:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b121a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3290:1874630694411776:0@lo:38: 00000040:00080000:2.0:1787787217.290652:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1787787217.290695:0:6670:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1787787217.290718:0:6670:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787787217.290732:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0701646e00/0xdeb1953cba4b0ec4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0ecb expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787217.290743:0:6670:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d0701646e00/0xdeb1953cba4b0ec4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0ecb expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787787217.290792:0:6670:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787787217.290794:0:6670:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787787217.290795:0:6670:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787787217.290797:0:6670:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787787217.290798:0:6670:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787787217.290803:0:6670:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787787217.290804:0:6670:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787787217.290806:0:6670:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787787217.290807:0:6670:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787787217.290808:0:6670:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787787217.290809:0:6670:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787787217.290812:0:6670:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1787787217.290814:0:6670:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787787217.290815:0:6670:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787787217.290816:0:6670:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787787217.290817:0:6670:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787787217.290818:0:6670:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787787217.290819:0:6670:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787787217.290820:0:6670:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787787217.290820:0:6670:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787787217.290821:0:6670:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787787217.290822:0:6670:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787787217.290823:0:6670:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787787217.290836:0:6670:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787787217.290848:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b121a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694411904:0@lo:253: 00000100:00100000:2.0:1787787217.290896:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787217.290920:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070595c840 going to sleep for 11 seconds 00000100:00100000:2.0:1787787217.290936:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694411904 00000100:00100000:2.0:1787787217.290940:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694411904 00000100:00100000:2.0:1787787217.290975:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787787217.290982:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+12:6670:x1874630694411904:12345-0@lo:253: 20000000:01000000:2.0:1787787217.291009:0:5813:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787787217.291021:0:5813:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787787217.330510:0:5813:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787787217.330558:0:5813:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787787217.331124:0:5835:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787787217.331130:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787787217.331215:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d070141e000/0xdeb1953cba4b0ee7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787217.331252:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0700030000/0xdeb1953cba4b0e54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0e4d expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787217.331261:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d070141e000/0xdeb1953cba4b0ee7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787217.331298:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0700030000/0xdeb1953cba4b0e54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b0e4d expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787217.331312:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0700030000/0xdeb1953cba4b0e54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b0e4d expref: 12 pid: 5813 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787217.331339:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07222a2940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5835:1874630694412032:0@lo:104: 00000100:00100000:3.0:1787787217.331397:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787217.331469:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0706984c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787787217.331532:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694412032 00000100:00100000:0.0:1787787217.331539:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694412032 00000100:00100000:0.0:1787787217.331588:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787787217.331597:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07222a1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1500c007-b35b-4004-b231-bb5a7ec082ef+3:5835:x1874630694412032:12345-0@lo:104: 00010000:00010000:0.0:1787787217.331610:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9d072212aa00/0xdeb1953cba4b0e4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0e54 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.331657:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787787217.331663:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07222a1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1500c007-b35b-4004-b231-bb5a7ec082ef+3:5835:x1874630694412032:12345-0@lo:104: Request processed in 68us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787217.331676:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787787217.331739:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787217.331746:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d072212aa00/0xdeb1953cba4b0e4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0e54 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.331754:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212aa00 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:1.0:1787787217.331758:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d072212aa00/0xdeb1953cba4b0e4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b0e54 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.331766:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d072212aa00/0xdeb1953cba4b0e4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b0e54 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787217.331773:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d072212aa00/0xdeb1953cba4b0e4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b0e54 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787217.331778:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787787217.331811:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d072212aa00/0xdeb1953cba4b0e4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0e54 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.331817:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787217.331833:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d072212aa00/0xdeb1953cba4b0e4d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0e54 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.331845:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d072212aa00/0xdeb1953cba4b0e4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0e54 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.331859:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787217.331860:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787217.331861:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787217.331873:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0722250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694412160:0@lo:103: 00000100:00100000:1.0:1787787217.331904:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787217.332771:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07222a2940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5835:1874630694412032:0@lo:104: 00010000:00010000:3.0:1787787217.332792:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d070141e000/0xdeb1953cba4b0ee7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787217.332820:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694412160 00000100:00100000:3.0:1787787217.332825:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694412160 00010000:00010000:3.0:1787787217.332844:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0700030000/0xdeb1953cba4b0e54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0e4d expref: 13 pid: 5813 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787217.332878:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787787217.332886:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0708739c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1500c007-b35b-4004-b231-bb5a7ec082ef+13:3294:x1874630694412160:12345-0@lo:103: 00010000:00010000:3.0:1787787217.332897:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787217.332902:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0700030000/0xdeb1953cba4b0e54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0e4d expref: 13 pid: 5813 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787217.332921:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0700030000/0xdeb1953cba4b0e54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b0e4d expref: 13 pid: 5813 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787217.332935:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0700030000/0xdeb1953cba4b0e54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b0e4d expref: 13 pid: 5813 timeout: 279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787217.332950:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d070141e000/0xdeb1953cba4b0ee7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787217.332957:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d070141e000/0xdeb1953cba4b0ee7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787787217.333071:0:5805:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001941498s 00010000:00010000:3.0:1787787217.333076:0:5805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d070141e000/0xdeb1953cba4b0ee7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787217.333083:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d070141e000/0xdeb1953cba4b0ee7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787217.333090:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d070141e000/0xdeb1953cba4b0ee7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787217.333096:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d070141e000/0xdeb1953cba4b0ee7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787217.333102:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d070141e000 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787217.333106:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d070141e000/0xdeb1953cba4b0ee7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787217.333113:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d070141e000/0xdeb1953cba4b0ee7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787217.333143:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d070141e000/0xdeb1953cba4b0ee7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787217.333223:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787217.333274:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0708739c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1500c007-b35b-4004-b231-bb5a7ec082ef+12:3294:x1874630694412160:12345-0@lo:103: Request processed in 389us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787217.333282:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787787217.333373:0:5835:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d070141e000/0xdeb1953cba4b0ee7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.333382:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d070141e000/0xdeb1953cba4b0ee7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787217.333388:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d070141e000/0xdeb1953cba4b0ee7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787217.333480:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0722250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694412160:0@lo:103: 00000100:00100000:0.0:1787787217.340810:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+11:6670:x1874630694411904:12345-0@lo:253: Request processed in 49820us (49905us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787217.340824:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787787217.340909:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b121a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:6670:1874630694411904:0@lo:253: 10000000:01000000:2.0:1787787217.340923:0:6670:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787787217.340927:0:6670:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787787217.340928:0:6670:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787787217.340929:0:6670:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787787217.340943:0:6670:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787787217.340944:0:6670:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787787217.340945:0:6670:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787787217.340946:0:6670:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787787217.340948:0:6670:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787787217.340949:0:6670:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787787217.340951:0:6670:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787787217.340952:0:6670:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787787217.341028:0:6670:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787787217.346113:0:6670:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787787217.346637:0:6670:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787787217.346860:0:6670:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787787217.347405:0:6670:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787787217.347634:0:6670:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787787217.347844:0:6670:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787787217.349054:0:6670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1787787217.533090:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1787787217.540866:0:6670:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787787217.540873:0:6670:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787787217.541049:0:6670:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787787217.541103:0:6670:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.110@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787787217.541118:0:6670:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787787217.541134:0:6670:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 10000000:01000000:1.0:1787787217.699593:0:5817:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787787217.699600:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d0722109800 from 21 10000000:01000000:1.0:1787787217.699605:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787787217.699645:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d072212aa00/0xdeb1953cba4b0eee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.699657:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d072212aa00/0xdeb1953cba4b0eee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.699668:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d072212aa00/0xdeb1953cba4b0eee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787217.699691:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0722250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694412288:0@lo:101: 00000100:00100000:1.0:1787787217.699765:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787217.699807:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0704e2f000 going to sleep for 11 seconds 00000100:00100000:2.0:1787787217.699911:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694412288 00000100:00100000:2.0:1787787217.699920:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694412288 00000100:00100000:1.0:1787787217.700073:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787787217.700084:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703090850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+11:5817:x1874630694412288:12345-0@lo:101: 00010000:00010000:1.0:1787787217.700095:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787217.700112:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d072212a000/0xdeb1953cba4b0ef5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b0eee expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.700133:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d072212a000/0xdeb1953cba4b0ef5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b0eee expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.700143:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d072212a000/0xdeb1953cba4b0ef5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0eee expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.700152:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d072212a000, rc 0) 00000100:00100000:1.0:1787787217.700187:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703090850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+12:5817:x1874630694412288:12345-0@lo:101: Request processed in 107us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787217.700204:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787787217.700244:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0722250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694412288:0@lo:101: 00010000:00010000:1.0:1787787217.700257:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d072212aa00/0xdeb1953cba4b0eee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0ef5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.700266:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d072212aa00/0xdeb1953cba4b0eee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b0ef5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787217.700310:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0722250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694412416:0@lo:501: 00000100:00100000:1.0:1787787217.700342:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787217.700359:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0704e2f000 going to sleep for 11 seconds 00000100:00100000:2.0:1787787217.700556:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694412416 00000100:00100000:2.0:1787787217.700560:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694412416 00000100:00100000:2.0:1787787217.700582:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787787217.700588:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+12:5817:x1874630694412416:12345-0@lo:501: 00000100:00100000:2.0:1787787217.700830:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+12:5817:x1874630694412416:12345-0@lo:501: Request processed in 242us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787217.700837:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787787217.701222:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0722250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694412416:0@lo:501: 00000100:00100000:1.0:1787787217.701251:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0722250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694412544:0@lo:503: 00000100:00100000:1.0:1787787217.701293:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787217.701330:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0704e2f000 going to sleep for 11 seconds 00000100:00100000:1.0:1787787217.702706:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694412544 00000100:00100000:1.0:1787787217.702724:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694412544 00000100:00100000:1.0:1787787217.702769:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787787217.702777:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+12:5817:x1874630694412544:12345-0@lo:503: 00000100:00100000:1.0:1787787217.705354:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+12:5817:x1874630694412544:12345-0@lo:503: Request processed in 2572us (4054us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787217.705367:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787787217.710378:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0722250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694412544:0@lo:503: 00000100:00100000:2.0:1787787217.712141:0:6710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b121a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:6710:1874630694412672:0@lo:502: 00000100:00100000:2.0:1787787217.712218:0:6710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787217.712255:0:6710:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0706984180 going to sleep for 11 seconds 00000100:00100000:1.0:1787787217.713218:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694412672 00000100:00100000:1.0:1787787217.713227:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694412672 00000100:00100000:1.0:1787787217.713269:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787787217.713278:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703090050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+12:6710:x1874630694412672:12345-0@lo:502: 00000100:00100000:1.0:1787787217.713551:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703090050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+12:6710:x1874630694412672:12345-0@lo:502: Request processed in 274us (1332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787217.713559:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787787217.714041:0:6710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b121a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:6710:1874630694412672:0@lo:502: 00000100:00100000:1.0:1787787217.714097:0:6710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07222512c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:6710:1874630694412800:0@lo:502: 00000100:00100000:1.0:1787787217.714140:0:6710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787217.714209:0:6710:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0704e2f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787217.714241:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694412800 00000100:00100000:2.0:1787787217.714247:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694412800 00000100:00100000:2.0:1787787217.714309:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787787217.714326:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+12:6710:x1874630694412800:12345-0@lo:502: 00000100:00100000:2.0:1787787217.714485:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+12:6710:x1874630694412800:12345-0@lo:502: Request processed in 169us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787217.714492:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787787217.714563:0:6710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07222512c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:6710:1874630694412800:0@lo:502: 00000040:00080000:1.0:1787787217.714585:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1787787217.714642:0:5817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1787787217.714661:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787787217.714670:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d072212aa00/0xdeb1953cba4b0eee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0ef5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.714680:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d072212aa00/0xdeb1953cba4b0eee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0ef5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787217.714714:0:5817:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787787217.714717:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d0722109800 from 4 10000000:01000000:1.0:1787787217.714720:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787787217.714743:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d072212b800/0xdeb1953cba4b0efc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.714751:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d072212b800/0xdeb1953cba4b0efc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.714759:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d072212b800/0xdeb1953cba4b0efc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787217.714772:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07222512c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694412928:0@lo:101: 00000100:00100000:1.0:1787787217.714802:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787217.714822:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0704e2f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787217.714834:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694412928 00000100:00100000:1.0:1787787217.714838:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694412928 00000100:00100000:1.0:1787787217.714860:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787787217.714866:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+12:5817:x1874630694412928:12345-0@lo:101: 00010000:00010000:1.0:1787787217.714886:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787217.714899:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d072212bc00/0xdeb1953cba4b0f03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b0efc expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.714919:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d072212bc00/0xdeb1953cba4b0f03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b0efc expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.714928:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d072212bc00/0xdeb1953cba4b0f03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0efc expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.714945:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d072212bc00, rc 0) 00000100:00100000:1.0:1787787217.715093:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+13:5817:x1874630694412928:12345-0@lo:101: Request processed in 226us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787217.715099:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787787217.715131:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07222512c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694412928:0@lo:101: 00010000:00010000:1.0:1787787217.715142:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d072212b800/0xdeb1953cba4b0efc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0f03 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.715151:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d072212b800/0xdeb1953cba4b0efc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b0f03 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787217.715196:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07222512c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694413056:0@lo:256: 00000100:00100000:1.0:1787787217.715224:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787217.715236:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0704e2f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787217.715247:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694413056 00000100:00100000:1.0:1787787217.715250:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694413056 00000100:00100000:1.0:1787787217.715268:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787787217.715274:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+13:5817:x1874630694413056:12345-0@lo:256: 20000000:01000000:1.0:1787787217.715286:0:5812:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787787217.715300:0:5812:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787787217.715303:0:5812:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1787787217.715381:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+13:5817:x1874630694413056:12345-0@lo:256: Request processed in 106us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787217.715387:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787787217.715476:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07222512c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694413056:0@lo:256: 10000000:01000000:1.0:1787787217.715536:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787787217.715546:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d072212b800/0xdeb1953cba4b0efc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0f03 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.715553:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d072212b800/0xdeb1953cba4b0efc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0f03 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787217.715561:0:5817:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787787217.715563:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1787787217.715565:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787787217.715581:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d072212a600/0xdeb1953cba4b0f0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.715588:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d072212a600/0xdeb1953cba4b0f0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.715596:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d072212a600/0xdeb1953cba4b0f0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787217.715608:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07222512c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694413184:0@lo:101: 00000100:00100000:1.0:1787787217.715633:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787217.715651:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0704e2f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787217.715663:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694413184 00000100:00100000:1.0:1787787217.715666:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694413184 00000100:00100000:1.0:1787787217.715683:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787787217.715689:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+13:5817:x1874630694413184:12345-0@lo:101: 00010000:00010000:1.0:1787787217.715696:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787217.715704:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d072212b400/0xdeb1953cba4b0f11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b0f0a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.715717:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d072212b400/0xdeb1953cba4b0f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b0f0a expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.715733:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d072212b400/0xdeb1953cba4b0f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0f0a expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.715739:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d072212b400, rc 0) 00000100:00100000:1.0:1787787217.715770:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+14:5817:x1874630694413184:12345-0@lo:101: Request processed in 81us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787217.715776:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787787217.715805:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07222512c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694413184:0@lo:101: 00010000:00010000:1.0:1787787217.715816:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d072212a600/0xdeb1953cba4b0f0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0f11 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.715824:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d072212a600/0xdeb1953cba4b0f0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b0f11 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787217.715862:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07222512c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694413312:0@lo:501: 00000100:00100000:1.0:1787787217.715955:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787217.716036:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0704e2f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787217.716049:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694413312 00000100:00100000:1.0:1787787217.716053:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694413312 00000100:00100000:1.0:1787787217.716073:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787787217.716078:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+14:5817:x1874630694413312:12345-0@lo:501: 00000100:00100000:1.0:1787787217.716292:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+14:5817:x1874630694413312:12345-0@lo:501: Request processed in 213us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787217.716299:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787787217.716338:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07222512c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694413312:0@lo:501: 00000100:00100000:1.0:1787787217.716382:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07222512c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694413440:0@lo:503: 00000100:00100000:1.0:1787787217.716470:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787217.716489:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0704e2f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787217.716499:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694413440 00000100:00100000:1.0:1787787217.716503:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694413440 00000100:00100000:1.0:1787787217.716520:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787787217.716526:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+14:5817:x1874630694413440:12345-0@lo:503: 00000100:00100000:1.0:1787787217.716713:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+14:5817:x1874630694413440:12345-0@lo:503: Request processed in 187us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787217.716720:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787787217.716759:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07222512c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694413440:0@lo:503: 00000100:00100000:0.0:1787787217.718360:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dfc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:6711:1874630694413568:0@lo:502: 00000100:00100000:0.0:1787787217.718503:0:6711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787217.718529:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694413568 00000100:00100000:0.0:1787787217.718534:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694413568 00000100:00100000:0.0:1787787217.718562:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787787217.718569:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+14:6711:x1874630694413568:12345-0@lo:502: 00000100:00100000:0.0:1787787217.718843:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+14:6711:x1874630694413568:12345-0@lo:502: Request processed in 273us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787217.718851:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787787217.718896:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07203f0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787787217.718913:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dfc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:6711:1874630694413568:0@lo:502: 00000020:01000000:0.0:1787787217.718936:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787787217.718943:0:6711:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787787217.718949:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787217.718956:0:6711:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787787217.718962:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787787217.718967:0:6711:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.110@tcp to nid 0x20000c0a8ce6e (192.168.206.110@tcp) 00000020:01000000:0.0:1787787217.718986:0:6711:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787787217.718989:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787787217.719001:0:6711:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9d072dfb99b8) 00000020:00000080:0.0:1787787217.719018:0:6711:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1787787217.719023:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787787217.719089:0:6711:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787787217.719095:0:6711:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787787217.719103:0:6711:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdeb1953cba4b0f1f 00010000:00080000:0.0:1787787217.719127:0:6711:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d07078ba000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.110@tcp at head 00010000:00010000:0.0:1787787217.720592:0:6711:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1787787217.774027:0:6711:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787787217.774047:0:6711:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787787217.774735:0:6711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787787217.775127:0:6711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787787217.775168:0:6711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787787217.775217:0:6711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1787787217.775787:0:6714:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787787217.775793:0:6714:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787787217.778206:0:6711:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787787217.778219:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787787217.778350:0:6711:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787787217.778368:0:6711:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdeb1953cba4b0f26 00000100:00080000:1.0:1787787217.778376:0:6711:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787787217.778382:0:6711:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d07078ba000 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:1.0:1787787217.778410:0:6711:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d07222512c0 x1874630694413696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787787217.778482:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07222512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1874630694413696:0@lo:8: 00000100:00100000:3.0:1787787217.778540:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787787217.778610:0:6711:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787787217.778670:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787787217.778675:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787217.778676:0:6711:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787787217.778680:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787787217.778683:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787217.778684:0:6711:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787787217.778687:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787787217.778689:0:6711:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787787217.778712:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0722250b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:6711:1874630694413824:0@lo:502: 00000100:00100000:1.0:1787787217.778754:0:6711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787217.778769:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07093d53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787217.778822:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694413824 00000100:00100000:1.0:1787787217.778827:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694413824 00000100:00100000:1.0:1787787217.778858:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787787217.778865:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+14:6711:x1874630694413824:12345-0@lo:502: 00000100:00100000:1.0:1787787217.779188:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+14:6711:x1874630694413824:12345-0@lo:502: Request processed in 321us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787217.779195:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787787217.779343:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0722250780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1874630694413952:0@lo:400: 00000100:00100000:1.0:1787787217.779375:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787217.779396:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787787217.779402:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0722250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694414080:0@lo:400: 00000100:00100000:1.0:1787787217.779424:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787217.779474:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694413952 00000100:00100000:1.0:1787787217.779478:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694413952 00000100:00100000:1.0:1787787217.779501:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694414080 00000100:00100000:1.0:1787787217.779503:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694414080 00000100:00100000:1.0:1787787217.779523:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787787217.779528:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0722252940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1874630694413952:12345-0@lo:400: 00000100:00100000:1.0:1787787217.779560:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0722252940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1874630694413952:12345-0@lo:400: Request processed in 32us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787217.779566:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787787217.779577:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787787217.779582:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07222521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694414080:12345-0@lo:400: 00000100:00100000:1.0:1787787217.779603:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07222521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694414080:12345-0@lo:400: Request processed in 22us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787217.779617:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787787217.779638:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787787217.779660:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0722250000 x1874630694414080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787217.779673:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0722250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694414080:0@lo:400: 00010000:00080000:1.0:1787787217.779681:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0722250780 x1874630694413952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787217.779688:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0722250780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1874630694413952:0@lo:400: 00000100:00100000:1.0:1787787217.779709:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0722250b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:6711:1874630694413824:0@lo:502: 00000020:01000000:1.0:1787787217.779729:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787787217.779733:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787217.779735:0:6711:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787787217.779737:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1787787217.779824:0:5817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1787787217.779841:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787787217.779849:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d072212a600/0xdeb1953cba4b0f0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0f11 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.779858:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d072212a600/0xdeb1953cba4b0f0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0f11 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787217.779866:0:5817:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787787217.779868:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d0722109800 from 1 10000000:01000000:1.0:1787787217.779871:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787787217.779893:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d072212ac00/0xdeb1953cba4b0f2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.779909:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d072212ac00/0xdeb1953cba4b0f2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.779918:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d072212ac00/0xdeb1953cba4b0f2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787217.779931:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0722250b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694414208:0@lo:101: 00000100:00100000:1.0:1787787217.780050:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787217.780067:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07093d53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787217.780079:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694414208 00000100:00100000:1.0:1787787217.780082:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694414208 00000100:00100000:1.0:1787787217.780101:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787787217.780106:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+14:5817:x1874630694414208:12345-0@lo:101: 00010000:00010000:1.0:1787787217.780114:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787217.780125:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d072212ba00/0xdeb1953cba4b0f34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b0f2d expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.780143:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d072212ba00/0xdeb1953cba4b0f34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b0f2d expref: 15 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.780151:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d072212ba00/0xdeb1953cba4b0f34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0f2d expref: 15 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.780159:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d072212ba00, rc 0) 00000100:00100000:1.0:1787787217.780183:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+15:5817:x1874630694414208:12345-0@lo:101: Request processed in 77us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787217.780188:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787787217.780213:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0722250b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694414208:0@lo:101: 00010000:00010000:1.0:1787787217.780229:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d072212ac00/0xdeb1953cba4b0f2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0f34 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787217.782037:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694413696 00000100:00100000:3.0:1787787217.782050:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694413696 00000100:00100000:3.0:1787787217.782121:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787787217.782128:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07222a2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3290:x1874630694413696:12345-0@lo:8: 00010000:00080000:3.0:1787787217.782153:0:6673:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 130 last 0 00000020:00000080:3.0:1787787217.782185:0:6673:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdeb1953cba4b0f3b 00002000:00100000:3.0:1787787217.782228:0:6673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9d0734131800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113934 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787787217.782232:0:6673:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1787787217.782236:0:6673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1787787217.782362:0:6673:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00010000:1.0:1787787217.782538:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d072212ac00/0xdeb1953cba4b0f2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b0f34 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1787787217.782568:0:6673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787787217.782596:0:6673:0:(import.c:65:import_set_state_nolock()) ffff9d0734131000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787787217.782613:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0722250b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694414336:0@lo:501: 00000100:00100000:3.0:1787787217.782677:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07222a2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3290:x1874630694413696:12345-0@lo:8: Request processed in 547us (4135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787217.782678:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787217.782694:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787787217.782709:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07093d53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787217.782727:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694414336 00000100:00100000:1.0:1787787217.782732:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694414336 00000100:00100000:1.0:1787787217.782764:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787787217.782772:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+15:5817:x1874630694414336:12345-0@lo:501: 00010000:00080000:3.0:1787787217.783126:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d07222512c0 x1874630694413696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787787227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787217.783138:0:3290:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787787217.783144:0:3290:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787787217.783151:0:3290:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787787217.783155:0:3290:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787787217.783158:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9d07078ba000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787787217.783206:0:3290:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787787217.783212:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07222512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1874630694413696:0@lo:8: 00000004:00080000:3.0:1787787217.783241:0:6714:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1787787217.783294:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+15:5817:x1874630694414336:12345-0@lo:501: Request processed in 520us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787217.783302:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000004:00080000:3.0:1787787217.783358:0:6714:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 130009918936ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787787217.783364:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0722250b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694414336:0@lo:501: 00000100:00100000:1.0:1787787217.783541:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0722250b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694414464:0@lo:503: 00000100:00100000:1.0:1787787217.783593:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787217.783626:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07093d53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787217.783798:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694414464 00000100:00100000:2.0:1787787217.783804:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694414464 00000100:00100000:2.0:1787787217.783839:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787787217.783847:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+15:5817:x1874630694414464:12345-0@lo:503: 00000100:00100000:2.0:1787787217.784194:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+15:5817:x1874630694414464:12345-0@lo:503: Request processed in 347us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787217.784201:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787787217.784241:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0722250b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694414464:0@lo:503: 00000100:00100000:3.0:1787787217.786935:0:6717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07222a0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:6717:1874630694414592:0@lo:502: 00000100:00100000:3.0:1787787217.787005:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787217.787157:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694414592 00000100:00100000:2.0:1787787217.787164:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694414592 00000100:00100000:2.0:1787787217.787203:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787787217.787213:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+15:6717:x1874630694414592:12345-0@lo:502: 00000100:00100000:3.0:1787787217.787294:0:6717:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d060111e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787217.788302:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+15:6717:x1874630694414592:12345-0@lo:502: Request processed in 1089us (1295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787217.788311:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787787217.788640:0:6717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07222a0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:6717:1874630694414592:0@lo:502: 00000020:01000000:3.0:1787787217.788670:0:6717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787217.788680:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787217.788683:0:6717:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787787217.788690:0:6717:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d0722109800 00000020:00000080:3.0:1787787217.788693:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787787217.789305:0:6717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07222a0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:6717:1874630694414720:0@lo:502: 00000100:00100000:3.0:1787787217.789365:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787217.789514:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694414720 00000100:00100000:3.0:1787787217.789541:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694414720 00000100:00100000:3.0:1787787217.789598:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787787217.789610:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+15:6717:x1874630694414720:12345-0@lo:502: 00000100:00100000:3.0:1787787217.789803:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+15:6717:x1874630694414720:12345-0@lo:502: Request processed in 195us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787217.789811:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787787217.789858:0:6717:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d060111e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787217.789887:0:6717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07222a0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:6717:1874630694414720:0@lo:502: 00000020:01000000:3.0:1787787217.789914:0:6717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787217.789921:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787217.789923:0:6717:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787787217.789927:0:6717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1787787217.789995:0:5817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787787217.790019:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787787217.790029:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d072212ac00/0xdeb1953cba4b0f2d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0f34 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787217.790040:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d072212ac00/0xdeb1953cba4b0f2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0f34 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787217.790051:0:5817:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787787217.790053:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9d0703128000 from 1 10000000:01000000:3.0:1787787217.790056:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787787217.790078:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d070141e800/0xdeb1953cba4b0f42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787217.790085:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d070141e800/0xdeb1953cba4b0f42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787217.790094:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d070141e800/0xdeb1953cba4b0f42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787217.790106:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07222a0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694414848:0@lo:101: 00000100:00100000:3.0:1787787217.790141:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787217.790158:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d060111e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787217.791262:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694414848 00000100:00100000:1.0:1787787217.791272:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694414848 00000100:00100000:1.0:1787787217.791397:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787787217.791410:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+15:5817:x1874630694414848:12345-0@lo:101: 00010000:00010000:1.0:1787787217.791423:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787217.791465:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d072212b000/0xdeb1953cba4b0f49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b0f42 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.791492:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d072212b000/0xdeb1953cba4b0f49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b0f42 expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.791504:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d072212b000/0xdeb1953cba4b0f49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0f42 expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787217.791883:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d072212b000, rc 0) 00000100:00100000:1.0:1787787217.791950:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+16:5817:x1874630694414848:12345-0@lo:101: Request processed in 544us (1807us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787217.791957:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787787217.791987:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07222a0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694414848:0@lo:101: 00010000:00010000:3.0:1787787217.792006:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d070141e800/0xdeb1953cba4b0f42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0f49 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787217.792017:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d070141e800/0xdeb1953cba4b0f42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b0f49 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787217.792072:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07222a0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694414976:0@lo:501: 00000100:00100000:3.0:1787787217.792108:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787217.792132:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d060111e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787217.792146:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694414976 00000100:00100000:3.0:1787787217.792149:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694414976 00000100:00100000:3.0:1787787217.792176:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787787217.792185:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+16:5817:x1874630694414976:12345-0@lo:501: 00000100:00100000:3.0:1787787217.792390:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+16:5817:x1874630694414976:12345-0@lo:501: Request processed in 207us (282us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787787217.792397:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787787217.792428:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07222a0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694414976:0@lo:501: 10000000:01000000:3.0:1787787217.792503:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787787217.792511:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d070141e800/0xdeb1953cba4b0f42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0f49 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787217.792519:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d070141e800/0xdeb1953cba4b0f42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0f49 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787787217.843113:0:5842:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1787787217.868078:0:6715:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787787217.868113:0:6715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07222a0780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6715:1874630694415232:0@lo:7: 00000100:00100000:3.0:1787787217.868176:0:6715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787217.868226:0:6715:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d060111ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787787217.868245:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787787217.868255:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07222a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694415104:0@lo:13: 00000100:00100000:3.0:1787787217.868289:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787217.868331:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694415232 00000100:00100000:3.0:1787787217.868337:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694415232 00000100:00100000:3.0:1787787217.868385:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787787217.868394:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07222a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6715:x1874630694415232:12345-0@lo:7: 00000100:00100000:0.0:1787787217.870062:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694415104 00000100:00100000:0.0:1787787217.870071:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694415104 00000100:00100000:0.0:1787787217.870119:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787787217.870129:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07222a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1874630694415104:12345-0@lo:13: 00002000:00000024:0.0:1787787217.870148:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:0.0:1787787217.870222:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07222a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1874630694415104:12345-0@lo:13: Request processed in 96us (1931us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787217.870231:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787787217.870371:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d07222a0b40 x1874630694415104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787217.870393:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07222a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694415104:0@lo:13: 00000100:00080000:2.0:1787787217.872672:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1787787217.874839:0:6675:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1787787217.874847:0:6675:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787787217.875054:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07222a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6715:x1874630694415232:12345-0@lo:7: Request processed in 6657us (6875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787217.875065:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787787217.875159:0:6715:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d07222a0780 x1874630694415232/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787787233 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787217.875175:0:6715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07222a0780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6715:1874630694415232:0@lo:7: 00000004:00080000:1.0:1787787217.875189:0:6715:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787787217.875226:0:6715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0722250b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6715:1874630694415360:0@lo:5: 00000100:00100000:1.0:1787787217.875258:0:6715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787217.875359:0:6715:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0706aaa840 going to sleep for 11 seconds 00000100:00100000:3.0:1787787217.875462:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694415360 00000100:00100000:3.0:1787787217.875469:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694415360 00000100:00100000:3.0:1787787217.875548:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787787217.875558:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0722250780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6715:x1874630694415360:12345-0@lo:5: 00002000:00080000:3.0:1787787217.875591:0:6673:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787787217.875595:0:6673:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787787217.875948:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0722250780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6715:x1874630694415360:12345-0@lo:5: Request processed in 391us (687us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787787217.875955:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787787217.876019:0:6715:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0722250b40 x1874630694415360/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787787233 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787217.876031:0:6715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0722250b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6715:1874630694415360:0@lo:5: 00000004:00080000:1.0:1787787217.876040:0:6715:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787787217.876064:0:6715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0722250000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6715:1874630694415488:0@lo:700: 00000100:00100000:1.0:1787787217.876091:0:6715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787217.876129:0:6715:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0706aaa840 going to sleep for 11 seconds 00000100:00100000:2.0:1787787217.876256:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694415488 00000100:00100000:2.0:1787787217.876261:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694415488 00000100:00100000:2.0:1787787217.876296:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787787217.876304:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07222503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6715:x1874630694415488:12345-0@lo:700: 00000100:00100000:2.0:1787787217.876347:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b121680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6681:1874630694415616:0@lo:700: 00000100:00100000:2.0:1787787217.876378:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787217.876395:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071858d300 going to sleep for 11 seconds 00000100:00100000:1.0:1787787217.876478:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694415616 00000100:00100000:1.0:1787787217.876482:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694415616 00000100:00100000:1.0:1787787217.876515:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787787217.876522:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b121a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6681:x1874630694415616:12345-0@lo:700: 40000000:02000000:1.0:1787787217.909597:0:5826:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1787787217.919767:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b121a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6681:x1874630694415616:12345-0@lo:700: Request processed in 43237us (43380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787217.919780:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787787217.919988:0:6681:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d071b121680 x1874630694415616/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787787233 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787217.920023:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b121680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6681:1874630694415616:0@lo:700: 40000000:02000000:3.0:1787787217.920035:0:6681:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1787787217.991153:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1787787217.991172:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787787217.991296:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07222503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6715:x1874630694415488:12345-0@lo:700: Request processed in 114989us (115200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787217.991323:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787787217.991399:0:6715:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0722250000 x1874630694415488/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787787233 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787217.991410:0:6715:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787787217.991424:0:6715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0722250000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6715:1874630694415488:0@lo:700: 00000004:02000040:1.0:1787787218.047570:0:6715:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1787787218.059281:0:6715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0722250000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6715:1874630694415744:0@lo:5: 00000100:00100000:1.0:1787787218.059360:0:6715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787218.059414:0:6715:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0706aaa600 going to sleep for 11 seconds 00000100:00100000:3.0:1787787218.059507:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694415744 00000100:00100000:3.0:1787787218.059515:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694415744 00000100:00100000:3.0:1787787218.059567:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787787218.059577:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0722250b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6715:x1874630694415744:12345-0@lo:5: 00002000:00080000:2.0:1787787218.073407:0:6674:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787787218.073428:0:6674:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1787787218.080537:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0722250b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6715:x1874630694415744:12345-0@lo:5: Request processed in 20955us (21170us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787787218.080549:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787787218.080655:0:6715:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0722250000 x1874630694415744/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787787234 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787218.080671:0:6715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0722250000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6715:1874630694415744:0@lo:5: 00000004:00080000:1.0:1787787218.080683:0:6715:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1787787218.565224:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787219.580647:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787220.609353:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787221.631894:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787222.652657:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787222.908601:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787787222.908628:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0722252d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694415872:0@lo:13: 00000100:00100000:3.0:1787787222.908706:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787222.908760:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694415872 00000100:00100000:0.0:1787787222.908768:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694415872 00000100:00100000:0.0:1787787222.908832:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787787222.908842:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07222a3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1874630694415872:12345-0@lo:13: 00002000:00000024:0.0:1787787222.908888:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787787222.909007:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787787222.909189:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07222a3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1874630694415872:12345-0@lo:13: Request processed in 348us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787222.909198:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787787222.909239:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0722252d00 x1874630694415872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787222.909258:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0722252d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694415872:0@lo:13: 00000100:00100000:0.0:1787787222.909606:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787787222.909617:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1874630694416256:0@lo:400: 00000100:00100000:0.0:1787787222.909655:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787222.909721:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874630694416128:0@lo:400: 00000100:00100000:3.0:1787787222.909749:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787222.909774:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787787222.909780:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694416000:0@lo:400: 00000100:00100000:3.0:1787787222.909808:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787222.909841:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694416000 00000100:00100000:3.0:1787787222.909860:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694416000 00000100:00100000:3.0:1787787222.909890:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787787222.909897:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+16:3292:x1874630694416000:12345-0@lo:400: 00000100:00100000:3.0:1787787222.909959:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+16:3292:x1874630694416000:12345-0@lo:400: Request processed in 63us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787222.909967:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787787222.910002:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694416000:0@lo:400: 00000100:00100000:1.0:1787787222.910213:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694416256 00000100:00100000:1.0:1787787222.910218:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694416256 00000100:00100000:1.0:1787787222.910273:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694416128 00000100:00100000:1.0:1787787222.910277:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694416128 00000100:00100000:1.0:1787787222.910304:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787787222.910311:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1874630694416256:12345-0@lo:400: 00000100:00100000:1.0:1787787222.910352:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1874630694416256:12345-0@lo:400: Request processed in 42us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787222.910358:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787787222.910369:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787787222.910374:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07222a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1874630694416128:12345-0@lo:400: 00000100:00100000:1.0:1787787222.910403:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07222a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1874630694416128:12345-0@lo:400: Request processed in 29us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787222.910408:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787787222.910460:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d071b1dc780 x1874630694416256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787222.910471:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1874630694416256:0@lo:400: 00010000:00080000:2.0:1787787222.910479:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d071b1df840 x1874630694416128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787222.910488:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874630694416128:0@lo:400: 00000100:00080000:3.0:1787787222.910629:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1787787223.144344:0:7042:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000001:00080000:2.0:1787787223.509639:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1787787223.676955:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787224.700675:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787225.725646:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787226.748901:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787227.773376:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787228.029628:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07222512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694416384:0@lo:13: 00000100:00100000:1.0:1787787228.029737:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787228.039602:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694416384 00000100:00100000:1.0:1787787228.039624:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694416384 00000100:00100000:1.0:1787787228.039727:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787787228.039743:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0722251680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694416384:12345-0@lo:13: 00002000:00000024:1.0:1787787228.039789:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787787228.039909:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0722251680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694416384:12345-0@lo:13: Request processed in 172us (10172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787228.039917:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787787228.040198:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d07222512c0 x1874630694416384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787228.040213:0:3294:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787787228.040239:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07222512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694416384:0@lo:13: 00000100:00100000:2.0:1787787228.041113:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787787228.041142:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07222512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694416512:0@lo:400: 00000100:00100000:2.0:1787787228.041223:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787228.041304:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694416512 00000100:00100000:2.0:1787787228.041311:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694416512 00000100:00100000:2.0:1787787228.041362:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787787228.041371:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+16:3292:x1874630694416512:12345-0@lo:400: 00000100:00100000:2.0:1787787228.041427:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+16:3292:x1874630694416512:12345-0@lo:400: Request processed in 56us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787228.041434:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787787228.041515:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07222512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694416512:0@lo:400: 00000100:00080000:3.0:1787787228.043112:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787228.044969:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787787228.045005:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0722250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1874630694416640:0@lo:400: 00000100:00100000:1.0:1787787228.045100:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787228.045158:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694416640 00000100:00100000:1.0:1787787228.045166:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694416640 00000100:00100000:0.0:1787787228.045225:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07222512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1874630694416768:0@lo:400: 00000100:00100000:1.0:1787787228.045228:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787787228.045239:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0722252d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1874630694416640:12345-0@lo:400: 00000100:00100000:1.0:1787787228.045320:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0722252d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1874630694416640:12345-0@lo:400: Request processed in 82us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787228.045328:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787787228.045636:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0722250000 x1874630694416640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787228.046542:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0722250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1874630694416640:0@lo:400: 00000100:00100000:0.0:1787787228.047713:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787228.048791:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694416768 00000100:00100000:1.0:1787787228.048806:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694416768 00000100:00100000:1.0:1787787228.048888:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787787228.048902:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874630694416768:12345-0@lo:400: 00000100:00100000:1.0:1787787228.049082:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874630694416768:12345-0@lo:400: Request processed in 185us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787228.049090:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1787787228.049121:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787787228.049136:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d07222512c0 x1874630694416768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787228.049153:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07222512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1874630694416768:0@lo:400: 00010000:00010000:2.0:1787787228.798273:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787229.821256:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787230.845765:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787231.868658:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787232.892888:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787233.151043:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787787233.151092:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07222512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694416896:0@lo:13: 00000100:00100000:1.0:1787787233.151184:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787233.151281:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694416896 00000100:00100000:0.0:1787787233.151291:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694416896 00000100:00100000:0.0:1787787233.151381:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787787233.151407:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694417024:0@lo:400: 00000100:00100000:2.0:1787787233.151468:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787233.151494:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787787233.151500:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b120b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1874630694417152:0@lo:400: 00000100:00100000:2.0:1787787233.151528:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787233.151556:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787787233.151559:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0722250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694416896:12345-0@lo:13: 00000100:00100000:2.0:1787787233.151566:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b121e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1874630694417280:0@lo:400: 00000100:00100000:2.0:1787787233.151593:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1787787233.151681:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787787233.151740:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787787233.151741:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0722250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694416896:12345-0@lo:13: Request processed in 351us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787233.151759:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787787233.151763:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694417024 00000100:00100000:1.0:1787787233.151769:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694417024 00000100:00100000:1.0:1787787233.151826:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787787233.151834:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+16:3291:x1874630694417024:12345-0@lo:400: 00000100:00100000:1.0:1787787233.151881:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+16:3291:x1874630694417024:12345-0@lo:400: Request processed in 49us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787233.151888:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787787233.151920:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694417152 00000100:00100000:1.0:1787787233.151924:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694417152 00000100:00100000:1.0:1787787233.151948:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694417280 00000100:00100000:1.0:1787787233.151951:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694417280 00000100:00100000:1.0:1787787233.151975:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787787233.151980:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b122580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1874630694417152:12345-0@lo:400: 00000100:00100000:1.0:1787787233.152013:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b122580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1874630694417152:12345-0@lo:400: Request processed in 33us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787233.152019:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787787233.152031:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787787233.152037:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b122d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1874630694417280:12345-0@lo:400: 00000100:00100000:1.0:1787787233.152068:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b122d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1874630694417280:12345-0@lo:400: Request processed in 32us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787233.152074:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1787787233.152096:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787787233.152125:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d071b121e00 x1874630694417280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787233.152141:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b121e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1874630694417280:0@lo:400: 00010000:00080000:1.0:1787787233.152184:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d07222512c0 x1874630694416896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787249 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787233.152200:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07222512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694416896:0@lo:13: 00010000:00080000:0.0:1787787233.152854:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d071b120b40 x1874630694417152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787233.152922:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b120b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1874630694417152:0@lo:400: 00000100:00100000:0.0:1787787233.152943:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694417024:0@lo:400: 00010000:00010000:3.0:1787787233.920335:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787234.940667:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787787234.955953:0:7612:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787787234.955958:0:7612:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787787234.956548:0:7612:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9d070598a000 00000020:01000004:3.0:1787787234.956572:0:7612:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787787234.956589:0:7612:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787787234.956607:0:7612:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9d073ca019b8) 00000020:00000080:3.0:1787787234.956626:0:7612:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787787234.999800:0:7612:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787787235.000558:0:7612:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1787787235.066790:0:7612:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1787787235.078180:0:7612:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787787235.078232:0:7612:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1787787235.078602:0:7612:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787787235.078631:0:7612:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1787787235.079494:0:7612:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787787235.079511:0:7612:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787787235.079527:0:7612:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdeb1953cba4b0f57 00000020:01000004:0.0:1787787235.079537:0:7612:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1787787235.079566:0:7612:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.110@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787787235.079570:0:7612:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.110@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787787235.079577:0:7612:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787787235.079607:0:7612:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1787787235.079612:0:7612:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.110@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787787235.148352:0:7612:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.110@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787787235.149274:0:7612:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.110@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1787787235.149283:0:7612:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787787235.149285:0:7612:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787787235.149287:0:7612:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787787235.149288:0:7612:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787787235.149290:0:7612:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787787235.149292:0:7612:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787787235.149294:0:7612:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787787235.149295:0:7612:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787787235.149297:0:7612:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787787235.149298:0:7612:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787787235.149300:0:7612:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787787235.149305:0:7612:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1787787235.149319:0:7612:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787787235.149320:0:7612:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787787235.149321:0:7612:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787787235.149322:0:7612:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787787235.149323:0:7612:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787787235.149324:0:7612:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787787235.149325:0:7612:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787787235.149326:0:7612:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787787235.149327:0:7612:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787787235.149328:0:7612:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787787235.149329:0:7612:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787787235.149383:0:7612:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787787235.149421:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07222a0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694417408:0@lo:253: 00000100:00100000:3.0:1787787235.149535:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787235.149617:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d072daf5480 going to sleep for 11 seconds 00000100:00100000:0.0:1787787235.149862:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694417408 00000100:00100000:0.0:1787787235.149872:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694417408 00000100:00100000:0.0:1787787235.149943:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787787235.149966:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+16:7612:x1874630694417408:12345-0@lo:253: 20000000:01000000:0.0:1787787235.150007:0:5813:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787787235.150012:0:5813:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1787787235.150019:0:5813:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1787787235.150023:0:5813:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1787787235.151285:0:5813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787787235.151576:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1787787235.151592:0:5813:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1787787235.151640:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1787787235.151650:0:5813:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1787787235.151683:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1787787235.151749:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1787787235.152096:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1787787235.152120:0:5813:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.110@tcp 20000000:01000000:0.0:1787787235.152122:0:5813:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.110@tcp (null) (null) (null) 00000040:00080000:0.0:1787787235.152158:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1787787235.152168:0:5813:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787787235.152229:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1787787235.152239:0:5813:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.110@tcp (null) (null) 00000040:00080000:0.0:1787787235.152274:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1787787235.152285:0:5813:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787787235.152320:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1787787235.152368:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1787787235.159664:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1787787235.159705:0:5813:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.110@tcp 20000000:01000000:0.0:1787787235.159709:0:5813:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.110@tcp (null) (null) (null) 00000040:00080000:0.0:1787787235.159750:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1787787235.159759:0:5813:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787787235.159792:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1787787235.159800:0:5813:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.110@tcp (null) (null) 00000040:00080000:0.0:1787787235.159836:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1787787235.159849:0:5813:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787787235.159917:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1787787235.159960:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1787787235.159981:0:5813:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1787787235.159985:0:5813:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1787787235.160001:0:5813:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787787235.160002:0:5813:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787787235.160005:0:5813:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787787235.160020:0:5813:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787787235.160023:0:5813:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787787235.160065:0:5813:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787787235.160068:0:5813:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787787235.161216:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1787787235.161801:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1787787235.161852:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1787787235.161945:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1787787235.162085:0:5813:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787787235.162088:0:5813:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787787235.171287:0:7615:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1787787235.171433:0:7615:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1787787235.171542:0:7615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1787787235.172107:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1787787235.172157:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1787787235.172240:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1787787235.172256:0:5813:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787787235.172259:0:5813:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787787235.174282:0:7616:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1787787235.174382:0:7616:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1787787235.174509:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1787787235.175072:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1787787235.175125:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1787787235.175163:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1787787235.175179:0:5813:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787787235.175182:0:5813:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787787235.177044:0:7617:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1787787235.177174:0:7617:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1787787235.177210:0:7617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1787787235.177669:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1787787235.177722:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1787787235.177779:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:1.0:1787787235.177802:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787787235.177827:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d072212be00/0xdeb1953cba4b0f5e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787235.177849:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0700030200/0xdeb1953cba4b0ea1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0e9a expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787235.177858:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0700031c00/0xdeb1953cba4b0ecb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0ec4 expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787235.177865:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d072212a000/0xdeb1953cba4b0ef5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0eee expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787235.177872:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d072212b400/0xdeb1953cba4b0f11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0f0a expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787235.177879:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d072212b000/0xdeb1953cba4b0f49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0f42 expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787235.177887:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d072212be00/0xdeb1953cba4b0f5e lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787235.177968:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d072212b000/0xdeb1953cba4b0f49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b0f42 expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787235.177986:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d072212b000/0xdeb1953cba4b0f49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b0f42 expref: 16 pid: 5814 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787235.178005:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e45e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5813:1874630694417536:0@lo:104: 00000100:00100000:1.0:1787787235.178104:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787787235.178169:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d072212b400/0xdeb1953cba4b0f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b0f0a expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787235.178178:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d072212b400/0xdeb1953cba4b0f11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b0f0a expref: 16 pid: 5812 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787235.178186:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e44f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5813:1874630694417664:0@lo:104: 00010000:00010000:1.0:1787787235.178216:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d072212a000/0xdeb1953cba4b0ef5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b0eee expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787235.178238:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d072212a000/0xdeb1953cba4b0ef5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b0eee expref: 16 pid: 5812 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787235.178246:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e470c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5813:1874630694417792:0@lo:104: 00010000:00010000:1.0:1787787235.178276:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0700031c00/0xdeb1953cba4b0ecb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b0ec4 expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787235.178285:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0700031c00/0xdeb1953cba4b0ecb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b0ec4 expref: 16 pid: 5813 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787235.178293:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e45a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5813:1874630694417920:0@lo:104: 00010000:00010000:1.0:1787787235.178330:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0700030200/0xdeb1953cba4b0ea1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b0e9a expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787235.178339:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0700030200/0xdeb1953cba4b0ea1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b0e9a expref: 16 pid: 5813 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787235.178347:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e47c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5813:1874630694418048:0@lo:104: 00000100:00100000:1.0:1787787235.178366:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0707d416c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787235.178596:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787787235.178618:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787235.178640:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787235.178650:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787235.178670:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787235.178690:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694417536 00000100:00100000:3.0:1787787235.178699:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694417536 00000100:00100000:3.0:1787787235.178741:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694417664 00000100:00100000:3.0:1787787235.178744:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694417664 00000100:00100000:3.0:1787787235.178755:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694417792 00000100:00100000:3.0:1787787235.178758:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694417792 00000100:00100000:3.0:1787787235.178766:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694417920 00000100:00100000:3.0:1787787235.178768:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694417920 00000100:00100000:3.0:1787787235.178776:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694418048 00000100:00100000:3.0:1787787235.178779:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694418048 00000100:00100000:3.0:1787787235.178794:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787787235.178804:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707233450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+7:5813:x1874630694417536:12345-0@lo:104: 00010000:00010000:3.0:1787787235.178821:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9d070141e800/0xdeb1953cba4b0f42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0f49 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.178892:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787787235.178898:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707233450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+7:5813:x1874630694417536:12345-0@lo:104: Request processed in 96us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787235.178906:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787787235.178969:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787787235.178976:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07222a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+6:5813:x1874630694417664:12345-0@lo:104: 00010000:00010000:3.0:1787787235.178985:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9d072212a600/0xdeb1953cba4b0f0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0f11 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.179019:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787787235.179024:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07222a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+6:5813:x1874630694417664:12345-0@lo:104: Request processed in 49us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787235.179030:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787787235.179042:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787787235.179048:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0711577480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+5:5813:x1874630694417792:12345-0@lo:104: 00010000:00010000:3.0:1787787235.179055:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9d072212aa00/0xdeb1953cba4b0eee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0ef5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.179082:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787787235.179087:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0711577480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+5:5813:x1874630694417792:12345-0@lo:104: Request processed in 40us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787235.179093:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787787235.179104:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787787235.179110:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0711574000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+4:5813:x1874630694417920:12345-0@lo:104: 00010000:00010000:3.0:1787787235.179117:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9d0701646e00/0xdeb1953cba4b0ec4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0ecb expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.179150:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787787235.179154:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0711574000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+4:5813:x1874630694417920:12345-0@lo:104: Request processed in 46us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787235.179160:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787787235.179172:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787787235.179177:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e48b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+3:5813:x1874630694418048:12345-0@lo:104: 00010000:00010000:3.0:1787787235.179184:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9d070141ee00/0xdeb1953cba4b0e9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0ea1 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.179208:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1787787235.179213:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e48b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+3:5813:x1874630694418048:12345-0@lo:104: Request processed in 37us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787235.179233:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1787787235.179253:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787787235.179259:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d070141e800/0xdeb1953cba4b0f42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0f49 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.179267:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d070141e800 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:3.0:1787787235.179272:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d070141e800/0xdeb1953cba4b0f42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b0f49 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.179281:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d070141e800/0xdeb1953cba4b0f42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b0f49 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787787235.179290:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d070141e800/0xdeb1953cba4b0f42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b0f49 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787235.179297:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787787235.179342:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d070141e800/0xdeb1953cba4b0f42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0f49 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.179349:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787787235.179372:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d070141e800/0xdeb1953cba4b0f42 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0f49 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.179379:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d070141e800/0xdeb1953cba4b0f42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0f49 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.179394:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787787235.179398:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d072212a600/0xdeb1953cba4b0f0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0f11 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.179403:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212a600 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:3.0:1787787235.179406:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d072212a600/0xdeb1953cba4b0f0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b0f11 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.179413:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d072212a600/0xdeb1953cba4b0f0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b0f11 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787787235.179419:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d072212a600/0xdeb1953cba4b0f0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b0f11 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787235.179423:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787787235.179435:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d072212a600/0xdeb1953cba4b0f0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0f11 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.179471:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787787235.179487:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d072212a600/0xdeb1953cba4b0f0a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0f11 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.179505:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d072212a600/0xdeb1953cba4b0f0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0f11 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.179516:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787787235.179519:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d072212aa00/0xdeb1953cba4b0eee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0ef5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.179524:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212aa00 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:3.0:1787787235.179528:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d072212aa00/0xdeb1953cba4b0eee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b0ef5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.179534:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d072212aa00/0xdeb1953cba4b0eee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b0ef5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787787235.179539:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d072212aa00/0xdeb1953cba4b0eee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b0ef5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787235.179544:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787787235.179558:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d072212aa00/0xdeb1953cba4b0eee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0ef5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.179564:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787787235.179570:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d072212aa00/0xdeb1953cba4b0eee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0ef5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.179575:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d072212aa00/0xdeb1953cba4b0eee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0ef5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.179584:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787787235.179592:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d0701646e00/0xdeb1953cba4b0ec4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0ecb expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.179597:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0701646e00 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:3.0:1787787235.179600:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d0701646e00/0xdeb1953cba4b0ec4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b0ecb expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.179607:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d0701646e00/0xdeb1953cba4b0ec4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b0ecb expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787787235.179612:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d0701646e00/0xdeb1953cba4b0ec4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b0ecb expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787235.179617:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787787235.179630:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d0701646e00/0xdeb1953cba4b0ec4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0ecb expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.179635:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787787235.179640:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d0701646e00/0xdeb1953cba4b0ec4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0ecb expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.179646:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d0701646e00/0xdeb1953cba4b0ec4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0ecb expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.179657:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787235.179660:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d070141ee00/0xdeb1953cba4b0e9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0ea1 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.179665:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d070141ee00 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:3.0:1787787235.179668:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d070141ee00/0xdeb1953cba4b0e9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b0ea1 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.179684:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d070141ee00/0xdeb1953cba4b0e9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b0ea1 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787787235.179689:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d070141ee00/0xdeb1953cba4b0e9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b0ea1 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787235.179694:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787787235.179708:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d070141ee00/0xdeb1953cba4b0e9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0ea1 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.179714:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787787235.179718:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d070141ee00/0xdeb1953cba4b0e9a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0ea1 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.179724:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d070141ee00/0xdeb1953cba4b0e9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0ea1 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.179737:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787235.179739:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787235.179740:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787235.179749:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787235.179763:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e49680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694418176:0@lo:103: 00000100:00100000:3.0:1787787235.179813:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787235.179847:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694418688:0@lo:103: 00000100:00100000:3.0:1787787235.179867:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787235.179888:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787787235.179893:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e4a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694418560:0@lo:103: 00000100:00100000:3.0:1787787235.179913:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787235.179952:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694418304:0@lo:103: 00000100:00100000:3.0:1787787235.179975:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787235.179988:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787787235.179992:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e4ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694418432:0@lo:103: 00000100:00100000:3.0:1787787235.180010:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787235.180032:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694418176 00000100:00100000:3.0:1787787235.180038:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694418176 00010000:00010000:3.0:1787787235.180076:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d072212b000/0xdeb1953cba4b0f49 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0f42 expref: 17 pid: 5814 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787235.180094:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694418688 00000100:00100000:3.0:1787787235.180097:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694418688 00010000:00010000:3.0:1787787235.180108:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0700030200/0xdeb1953cba4b0ea1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0e9a expref: 18 pid: 5813 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787235.180118:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694418560 00000100:00100000:3.0:1787787235.180120:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694418560 00010000:00010000:3.0:1787787235.180130:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0700031c00/0xdeb1953cba4b0ecb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0ec4 expref: 19 pid: 5813 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787235.180140:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694418304 00000100:00100000:3.0:1787787235.180142:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694418304 00010000:00010000:3.0:1787787235.180151:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d072212b400/0xdeb1953cba4b0f11 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0f0a expref: 20 pid: 5812 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787235.180160:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694418432 00000100:00100000:3.0:1787787235.180162:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694418432 00010000:00010000:3.0:1787787235.180171:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d072212a000/0xdeb1953cba4b0ef5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0eee expref: 21 pid: 5812 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787235.180183:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787787235.180189:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1500c007-b35b-4004-b231-bb5a7ec082ef+21:3294:x1874630694418176:12345-0@lo:103: 00010000:00010000:3.0:1787787235.180210:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787235.180216:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d072212b000/0xdeb1953cba4b0f49 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0f42 expref: 21 pid: 5814 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.180244:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d072212b000/0xdeb1953cba4b0f49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b0f42 expref: 21 pid: 5814 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.180265:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787235.180297:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1500c007-b35b-4004-b231-bb5a7ec082ef+21:3294:x1874630694418176:12345-0@lo:103: Request processed in 109us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787235.180305:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787787235.180320:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787787235.180326:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1500c007-b35b-4004-b231-bb5a7ec082ef+20:3294:x1874630694418688:12345-0@lo:103: 00010000:00010000:3.0:1787787235.180334:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787235.180338:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0700030200/0xdeb1953cba4b0ea1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0e9a expref: 20 pid: 5813 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.180347:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0700030200/0xdeb1953cba4b0ea1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b0e9a expref: 20 pid: 5813 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.180357:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787235.180378:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1500c007-b35b-4004-b231-bb5a7ec082ef+20:3294:x1874630694418688:12345-0@lo:103: Request processed in 53us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787235.180384:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787787235.180396:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787787235.180401:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e49e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3294:x1874630694418560:12345-0@lo:103: 00010000:00010000:3.0:1787787235.180409:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787235.180413:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0700031c00/0xdeb1953cba4b0ecb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0ec4 expref: 19 pid: 5813 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.180428:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0700031c00/0xdeb1953cba4b0ecb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b0ec4 expref: 19 pid: 5813 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.180471:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787235.180495:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e49e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3294:x1874630694418560:12345-0@lo:103: Request processed in 94us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787235.180502:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787787235.180515:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787787235.180521:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e48f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1500c007-b35b-4004-b231-bb5a7ec082ef+18:3291:x1874630694418304:12345-0@lo:103: 00010000:00010000:3.0:1787787235.180529:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787235.180534:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d072212b400/0xdeb1953cba4b0f11 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0f0a expref: 18 pid: 5812 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.180543:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d072212b400/0xdeb1953cba4b0f11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b0f0a expref: 18 pid: 5812 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.180553:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787235.180580:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e48f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1500c007-b35b-4004-b231-bb5a7ec082ef+18:3291:x1874630694418304:12345-0@lo:103: Request processed in 59us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787235.180586:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787787235.180598:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787787235.180604:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1500c007-b35b-4004-b231-bb5a7ec082ef+17:3291:x1874630694418432:12345-0@lo:103: 00010000:00010000:3.0:1787787235.180611:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787235.180616:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d072212a000/0xdeb1953cba4b0ef5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0eee expref: 17 pid: 5812 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.180626:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d072212a000/0xdeb1953cba4b0ef5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b0eee expref: 17 pid: 5812 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.180645:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d072212be00/0xdeb1953cba4b0f5e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.180655:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d072212be00/0xdeb1953cba4b0f5e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.180671:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d072212be00/0xdeb1953cba4b0f5e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.180679:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d072212be00/0xdeb1953cba4b0f5e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.180686:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d072212be00/0xdeb1953cba4b0f5e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.180694:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d072212be00/0xdeb1953cba4b0f5e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.180699:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212be00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787235.180703:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d072212be00/0xdeb1953cba4b0f5e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.180711:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d072212be00/0xdeb1953cba4b0f5e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.180719:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d072212be00/0xdeb1953cba4b0f5e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.180728:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787235.180752:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1500c007-b35b-4004-b231-bb5a7ec082ef+17:3291:x1874630694418432:12345-0@lo:103: Request processed in 148us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787235.180768:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787787235.180822:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e4a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694418560:0@lo:103: 00000100:00100000:3.0:1787787235.180833:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e49680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694418176:0@lo:103: 00000100:00100000:3.0:1787787235.180840:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694418688:0@lo:103: 00000100:00100000:3.0:1787787235.180874:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e4ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694418432:0@lo:103: 00000100:00100000:3.0:1787787235.180881:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694418304:0@lo:103: 00010000:00010000:0.0:1787787235.181673:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d072212b000/0xdeb1953cba4b0f49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b0f42 expref: 16 pid: 5814 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787235.181692:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e45e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5813:1874630694417536:0@lo:104: 00010000:00010000:0.0:1787787235.181705:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d072212b400/0xdeb1953cba4b0f11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b0f0a expref: 15 pid: 5812 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787235.181712:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e44f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5813:1874630694417664:0@lo:104: 00010000:00010000:0.0:1787787235.181741:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d072212a000/0xdeb1953cba4b0ef5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b0eee expref: 14 pid: 5812 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787235.181755:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e470c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5813:1874630694417792:0@lo:104: 00010000:00010000:0.0:1787787235.181767:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0700031c00/0xdeb1953cba4b0ecb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b0ec4 expref: 13 pid: 5813 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787235.181777:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e45a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5813:1874630694417920:0@lo:104: 00010000:00010000:0.0:1787787235.181789:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0700030200/0xdeb1953cba4b0ea1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b0e9a expref: 12 pid: 5813 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787235.181798:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e47c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5813:1874630694418048:0@lo:104: 00010000:00010000:0.0:1787787235.181826:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d072212be00/0xdeb1953cba4b0f5e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.181838:0:5813:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d072212be00/0xdeb1953cba4b0f5e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.181845:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d072212be00/0xdeb1953cba4b0f5e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.181851:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d072212be00/0xdeb1953cba4b0f5e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787787235.181869:0:5813:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787787235.242742:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+11:7612:x1874630694417408:12345-0@lo:253: Request processed in 92777us (93194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787235.242759:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787787235.242820:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07222a0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694417408:0@lo:253: 10000000:01000000:0.0:1787787235.242842:0:7612:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787787235.242846:0:7612:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787787235.242848:0:7612:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787787235.242866:0:7612:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787235.242869:0:7612:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1787787235.242870:0:7612:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787235.242872:0:7612:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787235.242873:0:7612:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787787235.242875:0:7612:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787787235.242877:0:7612:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787235.242878:0:7612:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787787235.242914:0:7612:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d070598a000 from lustre-OST0001 10000000:01000000:0.0:1787787235.242945:0:7612:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787787235.242949:0:7612:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787787235.242959:0:7612:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d0703128000 local copy 10000000:01000000:0.0:1787787235.242965:0:7612:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787787235.243014:0:7612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0700030200/0xdeb1953cba4b0f65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.243037:0:7612:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.110@tcp lock: ffff9d0700030200/0xdeb1953cba4b0f65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.243048:0:7612:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d0700030200/0xdeb1953cba4b0f65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787235.243071:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1de580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694418816:0@lo:101: 00000100:00100000:0.0:1787787235.243316:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787235.243374:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071858d600 going to sleep for 11 seconds 00000100:00100000:2.0:1787787235.243466:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694418816 00000100:00100000:2.0:1787787235.243474:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694418816 00000100:00100000:2.0:1787787235.243526:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787787235.243536:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+11:7612:x1874630694418816:12345-0@lo:101: 00010000:00010000:2.0:1787787235.243552:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787235.243570:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0701647400/0xdeb1953cba4b0f6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b0f65 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787235.243600:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0701647400/0xdeb1953cba4b0f6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b0f65 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787235.243623:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0701647400/0xdeb1953cba4b0f6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0f65 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787235.243634:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0701647400, rc 0) 00000100:00100000:2.0:1787787235.243684:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+12:7612:x1874630694418816:12345-0@lo:101: Request processed in 149us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787235.243691:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787787235.244017:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1de580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694418816:0@lo:101: 00010000:00010000:0.0:1787787235.244033:0:7612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d0700030200/0xdeb1953cba4b0f65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdeb1953cba4b0f6c expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.244044:0:7612:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d0700030200/0xdeb1953cba4b0f65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdeb1953cba4b0f6c expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787235.244209:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1de580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694418944:0@lo:501: 00000100:00100000:0.0:1787787235.244268:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787235.244304:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071858d600 going to sleep for 11 seconds 00000100:00100000:2.0:1787787235.246995:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694418944 00000100:00100000:2.0:1787787235.247015:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694418944 00000100:00100000:2.0:1787787235.247101:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787787235.247114:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+12:7612:x1874630694418944:12345-0@lo:501: 00000100:00100000:0.0:1787787235.252717:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+12:7612:x1874630694418944:12345-0@lo:501: Request processed in 5592us (8433us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787787235.252737:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787787235.252923:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1de580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694418944:0@lo:501: 10000000:01000000:3.0:1787787235.252955:0:7612:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.110@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787787235.253032:0:7612:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.110@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787787235.253042:0:7612:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0700030200/0xdeb1953cba4b0f65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdeb1953cba4b0f6c expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.253054:0:7612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0700030200/0xdeb1953cba4b0f65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdeb1953cba4b0f6c expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.253062:0:7612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff9d0700030200/0xdeb1953cba4b0f65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdeb1953cba4b0f6c expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.253097:0:7612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787787235.253140:0:7612:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d070598a000 10000000:01000000:3.0:1787787235.253146:0:7612:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787787235.253153:0:7612:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787787235.253155:0:7612:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787787235.253160:0:7612:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787787235.253164:0:7612:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787787235.253230:0:7612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d070141ee00/0xdeb1953cba4b0f73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.253239:0:7612:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d070141ee00/0xdeb1953cba4b0f73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.253251:0:7612:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d070141ee00/0xdeb1953cba4b0f73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787235.253276:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e483c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694419072:0@lo:101: 00000100:00100000:3.0:1787787235.253328:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787235.253376:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d072daf5300 going to sleep for 11 seconds 00000100:00100000:1.0:1787787235.253656:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694419072 00000100:00100000:1.0:1787787235.253665:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694419072 00000100:00100000:1.0:1787787235.253727:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787787235.253737:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+12:7612:x1874630694419072:12345-0@lo:101: 00010000:00010000:1.0:1787787235.253754:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787235.253771:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d072212be00/0xdeb1953cba4b0f7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b0f73 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787235.253830:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d072212be00/0xdeb1953cba4b0f7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b0f73 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787235.253844:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d072212be00/0xdeb1953cba4b0f7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0f73 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787235.253855:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d072212be00, rc 0) 00000100:00100000:1.0:1787787235.253913:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+13:7612:x1874630694419072:12345-0@lo:101: Request processed in 177us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787235.253920:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787787235.254209:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e483c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694419072:0@lo:101: 00010000:00010000:3.0:1787787235.254238:0:7612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d070141ee00/0xdeb1953cba4b0f73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0f7a expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.254249:0:7612:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d070141ee00/0xdeb1953cba4b0f73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b0f7a expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787235.254357:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e483c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694419200:0@lo:501: 00000100:00100000:3.0:1787787235.254406:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787235.254433:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d072daf5300 going to sleep for 11 seconds 00010000:00010000:0.0:1787787235.254584:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787235.254593:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d0700030200/0xdeb1953cba4b0f65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xdeb1953cba4b0f6c expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.254602:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0700030200 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:0.0:1787787235.254606:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d0700030200/0xdeb1953cba4b0f65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xdeb1953cba4b0f6c expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.254617:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d0700030200/0xdeb1953cba4b0f65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xdeb1953cba4b0f6c expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787787235.254626:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d0700030200/0xdeb1953cba4b0f65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xdeb1953cba4b0f6c expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787235.254633:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787787235.254659:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d0700030200/0xdeb1953cba4b0f65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdeb1953cba4b0f6c expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.254666:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787787235.254695:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d0700030200/0xdeb1953cba4b0f65 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdeb1953cba4b0f6c expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.254704:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d0700030200/0xdeb1953cba4b0f65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdeb1953cba4b0f6c expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.254721:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787235.254738:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787235.254740:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787235.254805:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787787235.254833:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694419328:0@lo:103: 00000100:00100000:2.0:1787787235.254889:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787235.254939:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694419200 00000100:00100000:2.0:1787787235.254945:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694419200 00000100:00100000:2.0:1787787235.254985:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787787235.254993:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+13:7612:x1874630694419200:12345-0@lo:501: 00000100:00100000:2.0:1787787235.255325:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+13:7612:x1874630694419200:12345-0@lo:501: Request processed in 331us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787235.255334:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787787235.255674:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694419328 00000100:00100000:0.0:1787787235.255680:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694419328 00000100:00100000:0.0:1787787235.255719:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787787235.255726:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b123840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1500c007-b35b-4004-b231-bb5a7ec082ef+13:3292:x1874630694419328:12345-0@lo:103: 00010000:00010000:0.0:1787787235.255740:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787235.255761:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0701647400/0xdeb1953cba4b0f6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdeb1953cba4b0f65 expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.255779:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787235.255827:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b123840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1500c007-b35b-4004-b231-bb5a7ec082ef+12:3292:x1874630694419328:12345-0@lo:103: Request processed in 101us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787235.255834:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787787235.256016:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694419328:0@lo:103: 00000100:00100000:3.0:1787787235.256572:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e483c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694419200:0@lo:501: 00000100:00100000:3.0:1787787235.256631:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e483c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694419456:0@lo:503: 00000100:00100000:3.0:1787787235.256702:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787235.256732:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d072daf5300 going to sleep for 11 seconds 00000100:00100000:2.0:1787787235.257145:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694419456 00000100:00100000:2.0:1787787235.257153:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694419456 00000100:00100000:2.0:1787787235.257206:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787787235.257214:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+12:7612:x1874630694419456:12345-0@lo:503: 00000100:00100000:2.0:1787787235.257526:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+12:7612:x1874630694419456:12345-0@lo:503: Request processed in 312us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787235.257534:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787787235.257749:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e483c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694419456:0@lo:503: 00000040:00080000:3.0:1787787235.258130:0:7612:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787787235.258257:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e483c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694419584:0@lo:502: 00000100:00100000:3.0:1787787235.258313:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787235.258371:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d072daf5300 going to sleep for 11 seconds 00000100:00100000:0.0:1787787235.258535:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694419584 00000100:00100000:0.0:1787787235.258542:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694419584 00000100:00100000:0.0:1787787235.258586:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787787235.258594:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+12:7612:x1874630694419584:12345-0@lo:502: 00000100:00100000:0.0:1787787235.258803:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+12:7612:x1874630694419584:12345-0@lo:502: Request processed in 209us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787235.258811:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787787235.259096:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e483c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694419584:0@lo:502: 00000040:00080000:3.0:1787787235.259434:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787787235.259532:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787787235.259567:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787787235.259618:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787787235.259654:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787787235.259691:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787787235.259730:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e483c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694419712:0@lo:502: 00000100:00100000:3.0:1787787235.259787:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787235.260199:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694419712 00000100:00100000:1.0:1787787235.260208:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694419712 00000100:00100000:1.0:1787787235.260262:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787787235.260271:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+12:7612:x1874630694419712:12345-0@lo:502: 00000100:00100000:1.0:1787787235.260535:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+12:7612:x1874630694419712:12345-0@lo:502: Request processed in 265us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787235.260543:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787787235.260765:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d072daf5300 going to sleep for 11 seconds 00000100:00100000:3.0:1787787235.260789:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e483c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694419712:0@lo:502: 00000040:00080000:3.0:1787787235.261081:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787787235.261097:0:7612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1787787235.262511:0:7621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787787235.262525:0:7621:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787787235.262533:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787235.262536:0:7621:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787787235.262542:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787787235.262561:0:7621:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9d07092d8000) 00000020:00000080:1.0:1787787235.262588:0:7621:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787787235.262595:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787787235.262664:0:7621:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d070598a000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787787235.262672:0:7621:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787787235.262679:0:7621:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdeb1953cba4b0f88 00010000:00010000:1.0:1787787235.269355:0:7621:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1787787235.270005:0:7621:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1787787235.273536:0:7621:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787787235.274009:0:7621:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1787787235.284526:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787787235.285054:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787787235.288413:0:7621:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787787235.288430:0:7621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787235.288476:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787235.288479:0:7621:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787787235.288485:0:7621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787235.288490:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787235.288492:0:7621:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787787235.288495:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787787235.288497:0:7621:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787787235.288568:0:7621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787235.288573:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787235.288574:0:7621:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787787235.288589:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787787235.288830:0:7612:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1787787235.288860:0:7612:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787787235.288895:0:7612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d070141ee00/0xdeb1953cba4b0f73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0f7a expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.288910:0:7612:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d070141ee00/0xdeb1953cba4b0f73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0f7a expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787235.288932:0:7612:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d070598a000 from 1 10000000:01000000:0.0:1787787235.288936:0:7612:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787787235.288981:0:7612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0700030200/0xdeb1953cba4b0f8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.288990:0:7612:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d0700030200/0xdeb1953cba4b0f8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.289003:0:7612:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d0700030200/0xdeb1953cba4b0f8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787235.289031:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694419840:0@lo:101: 00000100:00100000:0.0:1787787235.289123:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787235.289179:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0707d7ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1787787235.293920:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694419840 00000100:00100000:3.0:1787787235.293942:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694419840 00000100:00100000:3.0:1787787235.294026:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787787235.294040:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+12:7612:x1874630694419840:12345-0@lo:101: 00010000:00010000:3.0:1787787235.294063:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787235.294088:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d070141e800/0xdeb1953cba4b0f96 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b0f8f expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.294124:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d070141e800/0xdeb1953cba4b0f96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b0f8f expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.294138:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d070141e800/0xdeb1953cba4b0f96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0f8f expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.294150:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d070141e800, rc 0) 00000100:00100000:3.0:1787787235.296051:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+13:7612:x1874630694419840:12345-0@lo:101: Request processed in 2002us (6915us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787235.296067:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787787235.296214:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694419840:0@lo:101: 00010000:00010000:0.0:1787787235.296254:0:7612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d0700030200/0xdeb1953cba4b0f8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0f96 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.296269:0:7612:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d0700030200/0xdeb1953cba4b0f8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b0f96 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787235.299158:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694419968:0@lo:501: 00000100:00100000:0.0:1787787235.299278:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787235.299330:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0707d7ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1787787235.299544:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694419968 00000100:00100000:1.0:1787787235.299554:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694419968 00000100:00100000:1.0:1787787235.299698:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787787235.299710:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+13:7612:x1874630694419968:12345-0@lo:501: 00000100:00100000:1.0:1787787235.300063:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+13:7612:x1874630694419968:12345-0@lo:501: Request processed in 354us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787235.300072:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787787235.300155:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694419968:0@lo:501: 00000100:00100000:2.0:1787787235.300216:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b121680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694420096:0@lo:503: 00000100:00100000:2.0:1787787235.300276:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787235.302531:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07058a39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787235.302675:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694420096 00000100:00100000:0.0:1787787235.302685:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694420096 00000100:00100000:0.0:1787787235.302750:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787787235.302762:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+13:7612:x1874630694420096:12345-0@lo:503: 00000100:00100000:0.0:1787787235.304259:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+13:7612:x1874630694420096:12345-0@lo:503: Request processed in 1487us (3971us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787235.304277:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787787235.307989:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b121680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694420096:0@lo:503: 00000040:00080000:2.0:1787787235.308948:0:7612:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787787235.309083:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b121680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694420224:0@lo:502: 00000100:00100000:2.0:1787787235.309178:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787235.309503:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07058a39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787235.309775:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694420224 00000100:00100000:0.0:1787787235.309785:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694420224 00000100:00100000:0.0:1787787235.309941:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787787235.309954:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+13:7612:x1874630694420224:12345-0@lo:502: 00000100:00100000:0.0:1787787235.310275:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+13:7612:x1874630694420224:12345-0@lo:502: Request processed in 322us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787235.310285:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787787235.310401:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b121680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694420224:0@lo:502: 00000040:00080000:2.0:1787787235.310760:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787787235.310820:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787787235.310858:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b121680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694420352:0@lo:502: 00000100:00100000:2.0:1787787235.311166:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787235.311758:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07058a39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787235.311843:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694420352 00000100:00100000:0.0:1787787235.311851:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694420352 00000100:00100000:0.0:1787787235.311907:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787787235.311917:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+13:7612:x1874630694420352:12345-0@lo:502: 00000100:00100000:0.0:1787787235.312157:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+13:7612:x1874630694420352:12345-0@lo:502: Request processed in 240us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787235.312165:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787787235.312354:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b121680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694420352:0@lo:502: 00000040:00080000:2.0:1787787235.312552:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787787235.312567:0:7612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787787235.313359:0:7625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787787235.313382:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787235.313385:0:7625:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787787235.313393:0:7625:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d070598a000 00000020:00000080:2.0:1787787235.313395:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787787235.313429:0:7625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787787235.313432:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787235.313434:0:7625:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787787235.313453:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787787235.313636:0:7612:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787787235.313664:0:7612:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787787235.313693:0:7612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0700030200/0xdeb1953cba4b0f8f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0f96 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.313707:0:7612:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d0700030200/0xdeb1953cba4b0f8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0f96 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787235.313762:0:7612:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787787235.313766:0:7612:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d070598a000 10000000:01000000:0.0:1787787235.313769:0:7612:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d070598a000 10000000:01000000:0.0:1787787235.313779:0:7612:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787787235.313786:0:7612:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d070598a000 from 1 10000000:01000000:0.0:1787787235.313789:0:7612:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787787235.313834:0:7612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0700031c00/0xdeb1953cba4b0f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.313843:0:7612:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d0700031c00/0xdeb1953cba4b0f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.313855:0:7612:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d0700031c00/0xdeb1953cba4b0f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787235.313893:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694420480:0@lo:101: 00000100:00100000:0.0:1787787235.313965:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787235.314007:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07203f06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787235.314031:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694420480 00000100:00100000:0.0:1787787235.314038:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694420480 00000100:00100000:0.0:1787787235.314076:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787787235.314085:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+13:7612:x1874630694420480:12345-0@lo:101: 00010000:00010000:0.0:1787787235.314102:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787235.314115:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0700031800/0xdeb1953cba4b0fa4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b0f9d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.314144:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0700031800/0xdeb1953cba4b0fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b0f9d expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.314155:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0700031800/0xdeb1953cba4b0fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0f9d expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.314164:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0700031800, rc 0) 00000100:00100000:0.0:1787787235.314214:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+14:7612:x1874630694420480:12345-0@lo:101: Request processed in 129us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787235.314232:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787787235.314284:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694420480:0@lo:101: 00010000:00010000:0.0:1787787235.314301:0:7612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d0700031c00/0xdeb1953cba4b0f9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0fa4 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.314309:0:7612:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d0700031c00/0xdeb1953cba4b0f9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b0fa4 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787235.314423:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694420608:0@lo:501: 00000100:00100000:0.0:1787787235.314490:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787235.314504:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07203f06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787235.314517:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694420608 00000100:00100000:0.0:1787787235.314521:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694420608 00000100:00100000:0.0:1787787235.314538:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787787235.314543:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+14:7612:x1874630694420608:12345-0@lo:501: 00000100:00100000:0.0:1787787235.314786:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+14:7612:x1874630694420608:12345-0@lo:501: Request processed in 241us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787235.314794:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787787235.314827:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694420608:0@lo:501: 00000100:00100000:0.0:1787787235.314860:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694420736:0@lo:503: 00000100:00100000:0.0:1787787235.314901:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787235.314915:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07203f06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787235.314928:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694420736 00000100:00100000:0.0:1787787235.314932:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694420736 00000100:00100000:0.0:1787787235.314949:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787787235.314964:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+14:7612:x1874630694420736:12345-0@lo:503: 00000100:00100000:0.0:1787787235.315118:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+14:7612:x1874630694420736:12345-0@lo:503: Request processed in 154us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787235.315126:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787787235.315166:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694420736:0@lo:503: 00000040:00080000:0.0:1787787235.315513:0:7612:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787787235.315576:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694420864:0@lo:502: 00000100:00100000:0.0:1787787235.315618:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787235.315637:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07203f06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787235.315653:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694420864 00000100:00100000:0.0:1787787235.315657:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694420864 00000100:00100000:0.0:1787787235.315675:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787787235.315681:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+14:7612:x1874630694420864:12345-0@lo:502: 00000100:00100000:0.0:1787787235.315862:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+14:7612:x1874630694420864:12345-0@lo:502: Request processed in 180us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787235.315869:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787787235.315911:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694420864:0@lo:502: 00000040:00080000:0.0:1787787235.316173:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787787235.316236:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787787235.316274:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787787235.316323:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787787235.316358:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787787235.316399:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787787235.316432:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787787235.316830:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787787235.318805:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787787235.318919:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787787235.318976:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787787235.319046:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787787235.319087:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787787235.319122:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787787235.319169:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787787235.319204:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787787235.319250:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787787235.319301:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787787235.319338:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787787235.319549:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787787235.319605:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787787235.319641:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787787235.319675:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787787235.319724:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787787235.319757:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1787787235.319788:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1787787235.319832:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1787787235.319956:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1787787235.319995:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787787235.320071:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1787787235.320112:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1787787235.320148:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1787787235.320184:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1787787235.320250:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1787787235.320292:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1787787235.320342:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1787787235.320562:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1787787235.320629:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694420992:0@lo:502: 00000100:00100000:0.0:1787787235.320739:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787235.320854:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0706aaa840 going to sleep for 11 seconds 00000100:00100000:3.0:1787787235.321149:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694420992 00000100:00100000:3.0:1787787235.321158:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694420992 00000100:00100000:0.0:1787787235.321291:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787787235.321302:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+14:7612:x1874630694420992:12345-0@lo:502: 00000100:00100000:0.0:1787787235.321812:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+14:7612:x1874630694420992:12345-0@lo:502: Request processed in 509us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787235.321822:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787787235.322083:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694420992:0@lo:502: 00000040:00080000:1.0:1787787235.322202:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1787787235.322228:0:7612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1787787235.323314:0:7626:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787787235.323335:0:7626:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9d073ca04d28) 00000020:00000080:3.0:1787787235.323557:0:7626:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1787787235.323654:0:7626:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d070598a000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787787235.323659:0:7626:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d070598a000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787787235.323662:0:7626:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d070598a000 3 00010000:00080000:3.0:1787787235.323722:0:7626:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d073472e000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.110@tcp at head 00010000:00010000:0.0:1787787235.326711:0:7626:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1787787235.327089:0:7626:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787787235.327139:0:7626:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787787235.327184:0:7626:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xdeb1953cba4b0fb2 00000100:00080000:0.0:1787787235.327198:0:7626:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787787235.327206:0:7626:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d073472e000 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:0.0:1787787235.327263:0:7626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d071b1dda40 x1874630694421120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787787235.327292:0:7626:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787787235.327838:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3290:1874630694421120:0@lo:38: 00000100:00100000:3.0:1787787235.328004:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787235.328131:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694421120 00000100:00100000:1.0:1787787235.328146:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694421120 00000100:00100000:1.0:1787787235.328194:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787787235.328203:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3290:x1874630694421120:12345-0@lo:38: 00010000:00080000:1.0:1787787235.328241:0:5819:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 147 last 0 00000020:00000080:1.0:1787787235.328276:0:5819:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xdeb1953cba4b0fb9 00000004:00100000:1.0:1787787235.328294:0:5819:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787787235.328333:0:5819:0:(import.c:65:import_set_state_nolock()) ffff9d0708b6c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787787235.328413:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1874630694421120:12345-0@lo:38: Request processed in 210us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787235.328421:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787787235.328618:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d071b1dda40 x1874630694421120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787787245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787235.328630:0:3290:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787787235.328639:0:3290:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1787787235.328650:0:3290:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787787235.328654:0:3290:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787787235.328657:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9d073472e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787787235.328664:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3290:1874630694421120:0@lo:38: 00000100:00100000:3.0:1787787235.330242:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874630694421248:0@lo:400: 00000100:00100000:3.0:1787787235.330317:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787235.330395:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1874630694421376:0@lo:400: 00000100:00100000:3.0:1787787235.330423:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787235.330463:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787787235.330470:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694421504:0@lo:400: 00000100:00100000:3.0:1787787235.330497:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787235.330534:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694421504 00000100:00100000:3.0:1787787235.330541:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694421504 00000100:00100000:3.0:1787787235.330604:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787787235.330615:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e49680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694421504:12345-0@lo:400: 00000100:00100000:3.0:1787787235.330671:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e49680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694421504:12345-0@lo:400: Request processed in 58us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787235.330678:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787787235.330700:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787787235.330735:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d071b1dd680 x1874630694421504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787235.330749:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694421504:0@lo:400: 00000100:00100000:3.0:1787787235.330772:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694421248 00000100:00100000:3.0:1787787235.330776:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694421248 00000100:00100000:3.0:1787787235.330802:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694421376 00000100:00100000:3.0:1787787235.330805:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694421376 00000100:00100000:3.0:1787787235.330827:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787787235.330834:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e4ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1874630694421248:12345-0@lo:400: 00000100:00100000:3.0:1787787235.331008:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e4ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1874630694421248:12345-0@lo:400: Request processed in 173us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787235.331016:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787787235.331047:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787787235.331054:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874630694421376:12345-0@lo:400: 00000100:00100000:3.0:1787787235.331091:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874630694421376:12345-0@lo:400: Request processed in 37us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787235.331097:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1787787235.331112:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787787235.331135:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d071b1dc000 x1874630694421376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787235.331145:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1874630694421376:0@lo:400: 00010000:00080000:3.0:1787787235.331166:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d071b1dda40 x1874630694421248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787235.331176:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874630694421248:0@lo:400: 00000040:00080000:0.0:1787787235.332759:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:3.0:1787787235.333562:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e4a1c0 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7627:1874630694421632:0@lo:901: 00000100:00100000:3.0:1787787235.333646:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787235.333681:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d072daf5000 going to sleep for 11 seconds 00000100:00100000:0.0:1787787235.333796:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694421632 00000100:00100000:0.0:1787787235.333803:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694421632 00000100:00100000:0.0:1787787235.333936:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787787235.333948:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7627:x1874630694421632:12345-0@lo:901: 00000100:00080000:3.0:1787787235.334485:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:3.0:1787787235.334615:0:7612:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1787787235.334677:0:7612:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787787235.334697:0:7612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0700031c00/0xdeb1953cba4b0f9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0fa4 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.334710:0:7612:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d0700031c00/0xdeb1953cba4b0f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0fa4 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787787235.334773:0:7612:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787787235.334776:0:7612:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787787235.334777:0:7612:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787787235.334783:0:7612:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787787235.334785:0:7612:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787787235.334786:0:7612:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787787235.334788:0:7612:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787787235.334789:0:7612:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787787235.334791:0:7612:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787787235.334792:0:7612:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787787235.334794:0:7612:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787787235.334798:0:7612:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1787787235.334801:0:7612:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787787235.334802:0:7612:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787787235.334803:0:7612:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787787235.334804:0:7612:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787787235.334805:0:7612:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787787235.334806:0:7612:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787787235.334807:0:7612:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787787235.334808:0:7612:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787787235.334809:0:7612:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787787235.334810:0:7612:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787787235.334811:0:7612:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787787235.334836:0:7612:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787787235.334853:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e4bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694421760:0@lo:253: 00000100:00100000:0.0:1787787235.335041:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7627:x1874630694421632:12345-0@lo:901: Request processed in 1094us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787235.335059:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787787235.335562:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787235.335598:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694421760 00000100:00100000:3.0:1787787235.335606:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694421760 00000100:00100000:3.0:1787787235.335649:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787787235.335657:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+14:7612:x1874630694421760:12345-0@lo:253: 20000000:01000000:3.0:1787787235.335698:0:5814:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787787235.335716:0:5814:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1787787235.337041:0:7627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0737e4a1c0 x1874630694421632/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787787251 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787235.337063:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e4a1c0 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7627:1874630694421632:0@lo:901: 00000100:00100000:3.0:1787787235.338300:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d072daf5840 going to sleep for 11 seconds 20000000:01000000:3.0:1787787235.375819:0:5814:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787787235.375841:0:5814:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787787235.375908:0:5835:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787787235.375914:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787787235.375942:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d0700030e00/0xdeb1953cba4b0fc0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.375967:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d072212bc00/0xdeb1953cba4b0f03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0efc expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.375976:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d0700030e00/0xdeb1953cba4b0fc0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.376027:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d072212bc00/0xdeb1953cba4b0f03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b0efc expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.376044:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d072212bc00/0xdeb1953cba4b0f03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b0efc expref: 14 pid: 5812 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787235.376062:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1de1c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5835:1874630694421888:0@lo:104: 00000100:00100000:0.0:1787787235.376149:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787235.376213:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0734690540 going to sleep for 11 seconds 00000100:00100000:3.0:1787787235.376497:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694421888 00000100:00100000:3.0:1787787235.376506:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694421888 00000100:00100000:3.0:1787787235.376571:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787787235.376583:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1ded00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+3:5835:x1874630694421888:12345-0@lo:104: 00010000:00010000:3.0:1787787235.376616:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9d072212b800/0xdeb1953cba4b0efc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0f03 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.376679:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787787235.376685:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1ded00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+3:5835:x1874630694421888:12345-0@lo:104: Request processed in 105us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787235.376692:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1787787235.376719:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787235.376725:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d072212b800/0xdeb1953cba4b0efc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0f03 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.376733:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212b800 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:3.0:1787787235.376737:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d072212b800/0xdeb1953cba4b0efc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b0f03 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.376747:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d072212b800/0xdeb1953cba4b0efc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b0f03 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787787235.376755:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d072212b800/0xdeb1953cba4b0efc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b0f03 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787235.376762:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787787235.376797:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d072212b800/0xdeb1953cba4b0efc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0f03 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.376804:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787787235.376823:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d072212b800/0xdeb1953cba4b0efc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0f03 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.376831:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d072212b800/0xdeb1953cba4b0efc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0f03 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787235.376856:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787235.376971:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787235.376974:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787235.376991:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e4b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694422016:0@lo:103: 00000100:00100000:3.0:1787787235.377034:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787235.377158:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1de1c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5835:1874630694421888:0@lo:104: 00010000:00010000:0.0:1787787235.377182:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d0700030e00/0xdeb1953cba4b0fc0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787235.382753:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694422016 00000100:00100000:2.0:1787787235.382773:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694422016 00010000:00010000:0.0:1787787235.382917:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d072212bc00/0xdeb1953cba4b0f03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0efc expref: 15 pid: 5812 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787235.382970:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787787235.382980:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0708739850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+15:3291:x1874630694422016:12345-0@lo:103: 00010000:00010000:0.0:1787787235.383018:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787235.383025:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d072212bc00/0xdeb1953cba4b0f03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0efc expref: 15 pid: 5812 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.383040:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d072212bc00/0xdeb1953cba4b0f03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b0efc expref: 15 pid: 5812 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.383064:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d072212bc00/0xdeb1953cba4b0f03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b0efc expref: 15 pid: 5812 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.383086:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d0700030e00/0xdeb1953cba4b0fc0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.383096:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0700030e00/0xdeb1953cba4b0fc0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787787235.383118:0:5806:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007205138s 00010000:00010000:0.0:1787787235.383124:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d0700030e00/0xdeb1953cba4b0fc0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.383132:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d0700030e00/0xdeb1953cba4b0fc0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.383139:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d0700030e00/0xdeb1953cba4b0fc0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.383148:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d0700030e00/0xdeb1953cba4b0fc0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.383156:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0700030e00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:0.0:1787787235.383161:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d0700030e00/0xdeb1953cba4b0fc0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.383178:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d0700030e00/0xdeb1953cba4b0fc0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.383208:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d0700030e00/0xdeb1953cba4b0fc0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787235.383232:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787235.383345:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0708739850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+14:3291:x1874630694422016:12345-0@lo:103: Request processed in 354us (6297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787235.383354:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1787787235.383646:0:5835:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d0700030e00/0xdeb1953cba4b0fc0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787235.383656:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d0700030e00/0xdeb1953cba4b0fc0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787235.383664:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0700030e00/0xdeb1953cba4b0fc0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787235.383798:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e4b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694422016:0@lo:103: 00000100:00100000:2.0:1787787235.388831:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+13:7612:x1874630694421760:12345-0@lo:253: Request processed in 53161us (53257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787235.388850:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787787235.389015:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e4bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1500c007-b35b-4004-b231-bb5a7ec082ef:7612:1874630694421760:0@lo:253: 10000000:01000000:3.0:1787787235.389035:0:7612:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787787235.389039:0:7612:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787787235.389041:0:7612:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787787235.389043:0:7612:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787787235.389044:0:7612:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787787235.389045:0:7612:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787787235.389047:0:7612:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787787235.389048:0:7612:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787787235.389050:0:7612:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787787235.389051:0:7612:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787787235.389053:0:7612:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787787235.389054:0:7612:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787787235.389071:0:7612:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787787235.395528:0:7612:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787787235.395715:0:7612:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787787235.395965:0:7612:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787787235.396139:0:7612:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787787235.397232:0:7612:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787787235.397977:0:7612:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787787235.399310:0:7612:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787787235.654179:0:7612:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787787235.654189:0:7612:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787787235.654245:0:7612:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787787235.654322:0:7612:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.110@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787787235.654343:0:7612:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787787235.654379:0:7612:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1787787235.964595:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787236.989521:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787238.015227:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787238.268591:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787787238.268614:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694422144:0@lo:13: 00000100:00100000:1.0:1787787238.268677:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787238.268737:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694422144 00000100:00100000:1.0:1787787238.268744:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694422144 00000100:00100000:1.0:1787787238.268793:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787787238.268801:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e46940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694422144:12345-0@lo:13: 00002000:00000024:1.0:1787787238.268832:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787787238.268871:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e46940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694422144:12345-0@lo:13: Request processed in 71us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787238.268878:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787787238.268897:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787787238.268932:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0737e46580 x1874630694422144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787254 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787238.268949:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694422144:0@lo:13: 00010000:00010000:1.0:1787787239.036720:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787240.065291:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787240.834528:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e45680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874630694422400:0@lo:400: 00000100:00100000:1.0:1787787240.834595:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787240.834652:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787787240.834658:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694422272:0@lo:400: 00000100:00100000:1.0:1787787240.834687:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787240.834714:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1874630694422784:0@lo:400: 00000100:00100000:1.0:1787787240.834736:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787240.834761:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694422528:0@lo:400: 00000100:00100000:1.0:1787787240.834783:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787240.834801:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787787240.834806:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694422656:0@lo:400: 00000100:00100000:1.0:1787787240.834828:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787240.834859:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694422400 00000100:00100000:1.0:1787787240.834865:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694422400 00000100:00100000:1.0:1787787240.834901:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694422784 00000100:00100000:1.0:1787787240.834904:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694422784 00000100:00100000:1.0:1787787240.834925:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694422528 00000100:00100000:1.0:1787787240.834928:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694422528 00000100:00100000:1.0:1787787240.834945:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787787240.834953:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874630694422400:12345-0@lo:400: 00000100:00100000:1.0:1787787240.835002:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874630694422400:12345-0@lo:400: Request processed in 50us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787240.835009:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787787240.835039:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787787240.835045:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874630694422784:12345-0@lo:400: 00000100:00100000:1.0:1787787240.835074:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874630694422784:12345-0@lo:400: Request processed in 29us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787240.835080:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787787240.835091:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787787240.835097:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694422528:12345-0@lo:400: 00000100:00100000:1.0:1787787240.835127:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694422528:12345-0@lo:400: Request processed in 31us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787240.835133:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787787240.835160:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694422656 00000100:00080000:3.0:1787787240.836045:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787240.836095:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694422272 00000100:00100000:0.0:1787787240.836101:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694422272 00000100:00100000:0.0:1787787240.836185:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787787240.836205:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703094050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+13:3294:x1874630694422272:12345-0@lo:400: 00000100:00100000:0.0:1787787240.836324:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703094050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+13:3294:x1874630694422272:12345-0@lo:400: Request processed in 120us (1635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787240.836331:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787787240.836391:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694422656 00000100:00100000:1.0:1787787240.836430:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787787240.836452:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e47840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694422656:12345-0@lo:400: 00000100:00100000:1.0:1787787240.836490:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e47840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694422656:12345-0@lo:400: Request processed in 55us (1660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787240.836496:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787787240.836530:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694422272:0@lo:400: 00010000:00080000:1.0:1787787240.836546:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0737e461c0 x1874630694422784/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787240.836557:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1874630694422784:0@lo:400: 00010000:00080000:1.0:1787787240.836566:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0737e45680 x1874630694422400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787240.836574:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e45680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874630694422400:0@lo:400: 00010000:00080000:1.0:1787787240.836606:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0737e46d00 x1874630694422656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787240.836624:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694422656:0@lo:400: 00010000:00080000:1.0:1787787240.836637:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0737e443c0 x1874630694422528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787240.836645:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694422528:0@lo:400: 00000100:00080000:1.0:1787787240.836661:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787787241.084761:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787787241.803685:0:7968:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:3.0:1787787241.853552:0:5817:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787787241.853562:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d0707278800 from 30 10000000:01000000:3.0:1787787241.853568:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787787241.853637:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d070141e000/0xdeb1953cba4b0fc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787241.853652:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d070141e000/0xdeb1953cba4b0fc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787241.853665:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d070141e000/0xdeb1953cba4b0fc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787241.853692:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694422912:0@lo:101: 00000100:00100000:3.0:1787787241.853774:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787241.854004:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694422912 00000100:00100000:2.0:1787787241.854013:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694422912 00000100:00100000:2.0:1787787241.854072:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787787241.854081:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+13:5817:x1874630694422912:12345-0@lo:101: 00010000:00010000:2.0:1787787241.854096:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787241.854112:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0701647c00/0xdeb1953cba4b0fce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b0fc7 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787241.854140:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0701647c00/0xdeb1953cba4b0fce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b0fc7 expref: 14 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787241.854152:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0701647c00/0xdeb1953cba4b0fce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0fc7 expref: 14 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787241.854169:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0701647c00, rc 0) 00000100:00100000:2.0:1787787241.854220:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+14:5817:x1874630694422912:12345-0@lo:101: Request processed in 140us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787241.854227:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787787241.854524:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0737e60f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787787241.854553:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694422912:0@lo:101: 00010000:00010000:3.0:1787787241.854571:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d070141e000/0xdeb1953cba4b0fc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0fce expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787241.854581:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d070141e000/0xdeb1953cba4b0fc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b0fce expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787241.854648:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694423040:0@lo:501: 00000100:00100000:3.0:1787787241.854679:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787241.854700:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0737e60f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787787241.854765:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694423040 00000100:00100000:0.0:1787787241.854771:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694423040 00000100:00100000:0.0:1787787241.854802:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787787241.854818:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+14:5817:x1874630694423040:12345-0@lo:501: 00000100:00100000:0.0:1787787241.855266:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+14:5817:x1874630694423040:12345-0@lo:501: Request processed in 438us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787241.855274:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787787241.856114:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694423040:0@lo:501: 00000100:00100000:3.0:1787787241.856176:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694423168:0@lo:503: 00000100:00100000:3.0:1787787241.856252:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787241.856297:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0737e60f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787787241.856485:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694423168 00000100:00100000:0.0:1787787241.856494:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694423168 00000100:00100000:0.0:1787787241.856545:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787787241.856556:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+14:5817:x1874630694423168:12345-0@lo:503: 00000100:00100000:0.0:1787787241.856963:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+14:5817:x1874630694423168:12345-0@lo:503: Request processed in 407us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787241.856971:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787787241.858419:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694423168:0@lo:503: 00000100:00100000:3.0:1787787241.859500:0:7971:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e4a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:7971:1874630694423296:0@lo:502: 00000100:00100000:3.0:1787787241.859598:0:7971:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787241.859646:0:7971:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0737e60600 going to sleep for 11 seconds 00000100:00100000:2.0:1787787241.859777:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694423296 00000100:00100000:2.0:1787787241.859786:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694423296 00000100:00100000:2.0:1787787241.859845:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787787241.859856:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+14:7971:x1874630694423296:12345-0@lo:502: 00000100:00100000:2.0:1787787241.860284:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+14:7971:x1874630694423296:12345-0@lo:502: Request processed in 428us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787241.860293:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787787241.860803:0:7971:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e4a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:7971:1874630694423296:0@lo:502: 00000100:00100000:3.0:1787787241.860935:0:7971:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e4a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:7971:1874630694423424:0@lo:502: 00000100:00100000:3.0:1787787241.860988:0:7971:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787241.861238:0:7971:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0737e60600 going to sleep for 11 seconds 00000100:00100000:0.0:1787787241.861418:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694423424 00000100:00100000:0.0:1787787241.861425:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694423424 00000100:00100000:0.0:1787787241.861498:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787787241.861507:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+14:7971:x1874630694423424:12345-0@lo:502: 00000100:00100000:0.0:1787787241.861753:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+14:7971:x1874630694423424:12345-0@lo:502: Request processed in 248us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787241.861761:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787787241.863063:0:7971:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e4a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:7971:1874630694423424:0@lo:502: 00000040:00080000:3.0:1787787241.863115:0:7971:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787787241.863949:0:5817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787787241.863978:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787787241.863993:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d070141e000/0xdeb1953cba4b0fc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0fce expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787241.864007:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d070141e000/0xdeb1953cba4b0fc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0fce expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787241.864018:0:5817:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787787241.864021:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1787787241.864025:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787787241.864075:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d072212a000/0xdeb1953cba4b0fd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787241.864084:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d072212a000/0xdeb1953cba4b0fd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787241.864095:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d072212a000/0xdeb1953cba4b0fd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787241.864122:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e443c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694423552:0@lo:101: 00000100:00100000:1.0:1787787241.864226:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787241.864272:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07058a33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787241.865625:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694423552 00000100:00100000:3.0:1787787241.865641:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694423552 00000100:00100000:3.0:1787787241.865710:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787787241.865722:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+14:5817:x1874630694423552:12345-0@lo:101: 00010000:00010000:3.0:1787787241.865742:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787241.865764:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d070141f600/0xdeb1953cba4b0fdc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b0fd5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787241.865800:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d070141f600/0xdeb1953cba4b0fdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b0fd5 expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787241.865813:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d070141f600/0xdeb1953cba4b0fdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0fd5 expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787241.865823:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d070141f600, rc 0) 00000100:00100000:3.0:1787787241.865927:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+15:5817:x1874630694423552:12345-0@lo:101: Request processed in 207us (1701us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787241.865935:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787787241.867664:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e443c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694423552:0@lo:101: 00010000:00010000:2.0:1787787241.867702:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d072212a000/0xdeb1953cba4b0fd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0fdc expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787241.867719:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d072212a000/0xdeb1953cba4b0fd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b0fdc expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787241.867822:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b121680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694423680:0@lo:501: 00000100:00100000:2.0:1787787241.867908:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787241.867957:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070860fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787787241.868121:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694423680 00000100:00100000:3.0:1787787241.868136:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694423680 00000100:00100000:3.0:1787787241.868203:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787787241.868214:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703097050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+15:5817:x1874630694423680:12345-0@lo:501: 00000100:00100000:3.0:1787787241.868597:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703097050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+15:5817:x1874630694423680:12345-0@lo:501: Request processed in 385us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787241.868607:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787787241.868896:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b121680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694423680:0@lo:501: 00000100:00100000:2.0:1787787241.868943:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b121680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694423808:0@lo:503: 00000100:00100000:2.0:1787787241.869223:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787241.869274:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070860fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787787241.869429:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694423808 00000100:00100000:3.0:1787787241.869462:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694423808 00000100:00100000:3.0:1787787241.869504:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787787241.869513:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+15:5817:x1874630694423808:12345-0@lo:503: 00000100:00100000:0.0:1787787241.875192:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+15:5817:x1874630694423808:12345-0@lo:503: Request processed in 5647us (6167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787241.875209:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787787241.876307:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b121680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694423808:0@lo:503: 00000100:00100000:1.0:1787787241.877311:0:7973:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e46d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:7973:1874630694423936:0@lo:502: 00000100:00100000:1.0:1787787241.877422:0:7973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787241.877497:0:7973:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07058a33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787241.877560:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694423936 00000100:00100000:0.0:1787787241.877568:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694423936 00000100:00100000:0.0:1787787241.877626:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787787241.877636:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+15:7973:x1874630694423936:12345-0@lo:502: 00000100:00100000:0.0:1787787241.877961:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+15:7973:x1874630694423936:12345-0@lo:502: Request processed in 325us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787241.877978:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787787241.879011:0:7973:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e46d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:7973:1874630694423936:0@lo:502: 00000020:01000000:1.0:1787787241.879061:0:7973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787787241.879081:0:7973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787241.879084:0:7973:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787787241.879090:0:7973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787787241.879093:0:7973:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787787241.879133:0:7973:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e46d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:7973:1874630694424064:0@lo:502: 00000100:00100000:1.0:1787787241.879228:0:7973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787241.879274:0:7973:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07058a33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787241.879471:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694424064 00000100:00100000:0.0:1787787241.879479:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694424064 00000100:00100000:0.0:1787787241.879530:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787787241.879539:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+15:7973:x1874630694424064:12345-0@lo:502: 00000100:00100000:0.0:1787787241.879782:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+15:7973:x1874630694424064:12345-0@lo:502: Request processed in 243us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787241.879789:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787787241.880178:0:7973:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e46d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:7973:1874630694424064:0@lo:502: 00000020:01000000:2.0:1787787241.880219:0:7973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787787241.880228:0:7973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787241.880230:0:7973:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787787241.880235:0:7973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1787787241.880533:0:5817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787787241.880558:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787787241.880571:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d072212a000/0xdeb1953cba4b0fd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0fdc expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787241.880585:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d072212a000/0xdeb1953cba4b0fd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0fdc expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787241.880597:0:5817:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787787241.880601:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d0722109800 from 30 10000000:01000000:0.0:1787787241.880604:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787787241.880644:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0700030000/0xdeb1953cba4b0fe3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787241.880652:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d0700030000/0xdeb1953cba4b0fe3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787241.880663:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d0700030000/0xdeb1953cba4b0fe3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787241.880685:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1de1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694424192:0@lo:101: 00000100:00100000:0.0:1787787241.880749:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787241.880794:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070311e300 going to sleep for 11 seconds 00000100:00100000:2.0:1787787241.880958:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694424192 00000100:00100000:2.0:1787787241.880965:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694424192 00000100:00100000:2.0:1787787241.881132:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787787241.881143:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+15:5817:x1874630694424192:12345-0@lo:101: 00010000:00010000:2.0:1787787241.881157:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787241.881174:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0701646e00/0xdeb1953cba4b0fea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b0fe3 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787241.881213:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0701646e00/0xdeb1953cba4b0fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b0fe3 expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787241.881227:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0701646e00/0xdeb1953cba4b0fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0fe3 expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787241.881238:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0701646e00, rc 0) 00000100:00100000:2.0:1787787241.881286:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+16:5817:x1874630694424192:12345-0@lo:101: Request processed in 146us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787241.881294:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787787241.881337:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1de1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694424192:0@lo:101: 00010000:00010000:2.0:1787787241.881502:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d0700030000/0xdeb1953cba4b0fe3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0fea expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787241.881513:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d0700030000/0xdeb1953cba4b0fe3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b0fea expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787241.881591:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b121680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694424320:0@lo:501: 00000100:00100000:2.0:1787787241.881637:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787241.881660:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070860f480 going to sleep for 11 seconds 00000100:00100000:0.0:1787787241.881701:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694424320 00000100:00100000:0.0:1787787241.881706:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694424320 00000100:00100000:0.0:1787787241.881740:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787787241.881747:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+16:5817:x1874630694424320:12345-0@lo:501: 00000100:00100000:0.0:1787787241.882061:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+16:5817:x1874630694424320:12345-0@lo:501: Request processed in 313us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787241.882069:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787787241.882515:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b121680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694424320:0@lo:501: 00000100:00100000:2.0:1787787241.882567:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b121680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694424448:0@lo:503: 00000100:00100000:2.0:1787787241.882637:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787241.882662:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070860f480 going to sleep for 11 seconds 00000100:00100000:0.0:1787787241.882728:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694424448 00000100:00100000:0.0:1787787241.882735:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694424448 00000100:00100000:0.0:1787787241.882775:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787787241.882785:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+16:5817:x1874630694424448:12345-0@lo:503: 00000100:00100000:0.0:1787787241.883465:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+16:5817:x1874630694424448:12345-0@lo:503: Request processed in 650us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787241.883476:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787787241.883553:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b121680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694424448:0@lo:503: 00000100:00100000:2.0:1787787241.891684:0:7974:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b123840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:7974:1874630694424576:0@lo:502: 00000100:00100000:2.0:1787787241.891802:0:7974:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787241.891871:0:7974:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070860fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1787787241.892285:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694424576 00000100:00100000:3.0:1787787241.892295:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694424576 00000100:00100000:3.0:1787787241.892373:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787787241.892385:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+16:7974:x1874630694424576:12345-0@lo:502: 00000100:00100000:3.0:1787787241.892715:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+16:7974:x1874630694424576:12345-0@lo:502: Request processed in 331us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787241.892725:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787787241.892957:0:7974:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b123840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:7974:1874630694424576:0@lo:502: 00000100:00100000:2.0:1787787241.893119:0:7974:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b123840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:7974:1874630694424704:0@lo:502: 00000100:00100000:2.0:1787787241.893164:0:7974:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787241.893214:0:7974:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070860fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787787241.893214:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694424704 00000100:00100000:1.0:1787787241.893220:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694424704 00000100:00100000:1.0:1787787241.893260:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787787241.893269:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+16:7974:x1874630694424704:12345-0@lo:502: 00000100:00100000:1.0:1787787241.894208:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+16:7974:x1874630694424704:12345-0@lo:502: Request processed in 933us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787241.894219:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787787241.894400:0:7974:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b123840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:7974:1874630694424704:0@lo:502: 00000040:00080000:2.0:1787787241.894463:0:7974:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787787241.894870:0:5817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787787241.894897:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787787241.894912:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0700030000/0xdeb1953cba4b0fe3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0fea expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787241.894926:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d0700030000/0xdeb1953cba4b0fe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0fea expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787241.894937:0:5817:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787787241.894940:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d0722109800 from 5 10000000:01000000:0.0:1787787241.894944:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787787241.895092:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0700030a00/0xdeb1953cba4b0ff1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787241.895101:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d0700030a00/0xdeb1953cba4b0ff1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787241.895114:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d0700030a00/0xdeb1953cba4b0ff1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787241.895141:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694424832:0@lo:101: 00000100:00100000:0.0:1787787241.895212:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787241.895256:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070311ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787787241.895654:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694424832 00000100:00100000:2.0:1787787241.895664:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694424832 00000100:00100000:2.0:1787787241.895732:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787787241.895743:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+16:5817:x1874630694424832:12345-0@lo:101: 00010000:00010000:2.0:1787787241.895759:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787241.895776:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0701647400/0xdeb1953cba4b0ff8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b0ff1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787241.895822:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0701647400/0xdeb1953cba4b0ff8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b0ff1 expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787241.895835:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0701647400/0xdeb1953cba4b0ff8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0ff1 expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787241.895845:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0701647400, rc 0) 00000100:00100000:2.0:1787787241.895905:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+17:5817:x1874630694424832:12345-0@lo:101: Request processed in 163us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787241.895912:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787787241.895952:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694424832:0@lo:101: 00010000:00010000:1.0:1787787241.895970:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d0700030a00/0xdeb1953cba4b0ff1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0ff8 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787241.895980:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d0700030a00/0xdeb1953cba4b0ff1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b0ff8 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787241.896048:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e45680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694424960:0@lo:256: 00000100:00100000:1.0:1787787241.896085:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787241.896118:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07058a3300 going to sleep for 11 seconds 00000100:00100000:2.0:1787787241.896362:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694424960 00000100:00100000:2.0:1787787241.896367:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694424960 00000100:00100000:2.0:1787787241.896399:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787787241.896407:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703093050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+17:5817:x1874630694424960:12345-0@lo:256: 20000000:01000000:2.0:1787787241.896423:0:5813:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787787241.896467:0:5813:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787787241.896471:0:5813:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1787787241.896565:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703093050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+17:5817:x1874630694424960:12345-0@lo:256: Request processed in 159us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787241.896572:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787787241.897524:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e45680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694424960:0@lo:256: 10000000:01000000:1.0:1787787241.897609:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787787241.897623:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0700030a00/0xdeb1953cba4b0ff1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0ff8 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787241.897635:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d0700030a00/0xdeb1953cba4b0ff1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0ff8 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787241.897647:0:5817:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787787241.897650:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1787787241.897653:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787787241.897696:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d072212bc00/0xdeb1953cba4b0fff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787241.897705:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d072212bc00/0xdeb1953cba4b0fff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787241.897716:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d072212bc00/0xdeb1953cba4b0fff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787241.897738:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e45680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694425088:0@lo:101: 00000100:00100000:1.0:1787787241.897810:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787241.897844:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07058a3300 going to sleep for 11 seconds 00000100:00100000:0.0:1787787241.897969:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694425088 00000100:00100000:0.0:1787787241.897977:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694425088 00000100:00100000:0.0:1787787241.898057:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787787241.898070:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+17:5817:x1874630694425088:12345-0@lo:101: 00010000:00010000:0.0:1787787241.898086:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787241.898101:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b1006 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b0fff expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787241.898129:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b1006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b0fff expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787241.898141:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b1006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0fff expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787241.898150:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0700031a00, rc 0) 00000100:00100000:0.0:1787787241.898207:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+18:5817:x1874630694425088:12345-0@lo:101: Request processed in 141us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787241.898213:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787787241.898716:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e45680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694425088:0@lo:101: 00010000:00010000:1.0:1787787241.898742:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d072212bc00/0xdeb1953cba4b0fff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b1006 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787241.898752:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d072212bc00/0xdeb1953cba4b0fff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b1006 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787241.898817:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e45680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694425216:0@lo:501: 00000100:00100000:1.0:1787787241.898866:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787241.898901:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07058a3300 going to sleep for 11 seconds 00000100:00100000:0.0:1787787241.898919:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694425216 00000100:00100000:0.0:1787787241.898924:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694425216 00000100:00100000:0.0:1787787241.898961:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787787241.898969:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+18:5817:x1874630694425216:12345-0@lo:501: 00000100:00100000:0.0:1787787241.899333:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+18:5817:x1874630694425216:12345-0@lo:501: Request processed in 362us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787241.899350:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787787241.900031:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e45680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694425216:0@lo:501: 00000100:00100000:1.0:1787787241.900087:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e45680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694425344:0@lo:503: 00000100:00100000:1.0:1787787241.900161:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787241.900211:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07058a3300 going to sleep for 11 seconds 00000100:00100000:2.0:1787787241.900258:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694425344 00000100:00100000:2.0:1787787241.900266:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694425344 00000100:00100000:2.0:1787787241.900319:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787787241.900328:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+18:5817:x1874630694425344:12345-0@lo:503: 00000100:00100000:2.0:1787787241.900807:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+18:5817:x1874630694425344:12345-0@lo:503: Request processed in 476us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787241.900816:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787787241.901055:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e45680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694425344:0@lo:503: 00000100:00100000:3.0:1787787241.902935:0:7975:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e4a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:7975:1874630694425472:0@lo:502: 00000100:00100000:3.0:1787787241.903165:0:7975:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787241.903228:0:7975:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0737e606c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787241.903331:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694425472 00000100:00100000:2.0:1787787241.910273:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694425472 00000100:00100000:2.0:1787787241.910396:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787787241.910409:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703092050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+18:7975:x1874630694425472:12345-0@lo:502: 00000100:00100000:2.0:1787787241.910903:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703092050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+18:7975:x1874630694425472:12345-0@lo:502: Request processed in 495us (7736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787241.910914:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787787241.911144:0:7975:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e4a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:7975:1874630694425472:0@lo:502: 00000020:01000000:1.0:1787787241.911199:0:7975:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787787241.911210:0:7975:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787787241.911219:0:7975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787241.911221:0:7975:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787787241.911227:0:7975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787787241.911231:0:7975:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.110@tcp to nid 0x20000c0a8ce6e (192.168.206.110@tcp) 00000020:01000000:1.0:1787787241.911262:0:7975:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787787241.911265:0:7975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787787241.911283:0:7975:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9d07092db370) 00000020:00000080:1.0:1787787241.911320:0:7975:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1787787241.911326:0:7975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787787241.911432:0:7975:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787787241.911470:0:7975:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787787241.911493:0:7975:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdeb1953cba4b1014 00010000:00080000:1.0:1787787241.911532:0:7975:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d073d87f000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.110@tcp at head 00010000:00010000:1.0:1787787241.911838:0:7975:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1787787241.912269:0:7975:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1787787241.912286:0:7975:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787787241.912907:0:7975:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787787241.913168:0:7975:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787787241.913238:0:7975:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1787787241.913303:0:7975:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1787787241.918806:0:7977:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787787241.918818:0:7977:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787787241.937241:0:7975:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787787241.937262:0:7975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787787241.937308:0:7975:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787787241.937336:0:7975:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdeb1953cba4b101b 00000100:00080000:0.0:1787787241.937426:0:7975:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787787241.937434:0:7975:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d073d87f000 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:0.0:1787787241.937519:0:7975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d071b1dd2c0 x1874630694425600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787787241.937546:0:7975:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787787241.937609:0:7975:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787241.937613:0:7975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787241.937616:0:7975:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787787241.937619:0:7975:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787241.937624:0:7975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787241.937626:0:7975:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787787241.937629:0:7975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787787241.937631:0:7975:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787787241.937666:0:7975:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1de1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:7975:1874630694425728:0@lo:502: 00000100:00100000:0.0:1787787241.937764:0:7975:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787241.937810:0:7975:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070311e480 going to sleep for 11 seconds 00000100:00100000:0.0:1787787241.937896:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874630694425856:0@lo:400: 00000100:00100000:0.0:1787787241.937926:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787241.937957:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787787241.937963:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1874630694426240:0@lo:400: 00000100:00100000:0.0:1787787241.937984:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787241.938011:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694425984:0@lo:400: 00000100:00100000:0.0:1787787241.938033:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787241.938051:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787787241.938056:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694426112:0@lo:400: 00000100:00100000:0.0:1787787241.938078:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787241.938113:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694425856 00000100:00100000:0.0:1787787241.938120:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694425856 00000100:00100000:0.0:1787787241.938156:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694426240 00000100:00100000:0.0:1787787241.938159:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694426240 00000100:00100000:0.0:1787787241.938170:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694425984 00000100:00100000:0.0:1787787241.938173:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694425984 00000100:00100000:2.0:1787787241.938275:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1874630694425600:0@lo:8: 00000100:00100000:2.0:1787787241.938318:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787241.938375:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694426112 00000100:00100000:2.0:1787787241.938379:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694426112 00000100:00100000:2.0:1787787241.938408:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694425600 00000100:00100000:2.0:1787787241.938412:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694425600 00000100:00100000:2.0:1787787241.938427:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787787241.938452:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694426112:12345-0@lo:400: 00000100:00100000:2.0:1787787241.938515:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694426112:12345-0@lo:400: Request processed in 79us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787241.938523:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787787241.938542:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787787241.938547:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b123840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3290:x1874630694425600:12345-0@lo:8: 00010000:00080000:2.0:1787787241.938572:0:6673:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:2.0:1787787241.938602:0:6673:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdeb1953cba4b1022 00002000:00100000:2.0:1787787241.938620:0:6673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9d073762a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113934 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787787241.938625:0:6673:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1787787241.938630:0:6673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787787241.938786:0:6673:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787787241.938971:0:6673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787787241.939008:0:6673:0:(import.c:65:import_set_state_nolock()) ffff9d073762f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787241.939050:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b123840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3290:x1874630694425600:12345-0@lo:8: Request processed in 502us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787241.939057:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787787241.939104:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d071b1dd2c0 x1874630694425600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787787251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787241.939115:0:3290:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787787241.939125:0:3290:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787787241.939134:0:3290:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787787241.939139:0:3290:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787787241.939142:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9d073d87f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787787241.939162:0:3290:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787787241.939166:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1874630694425600:0@lo:8: 00010000:00080000:2.0:1787787241.939218:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d071b1dd680 x1874630694426112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787241.939229:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694426112:0@lo:400: 00000100:00100000:2.0:1787787241.939250:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694425728 00000100:00100000:2.0:1787787241.939254:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694425728 00000100:00100000:2.0:1787787241.939281:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787787241.939288:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+18:7975:x1874630694425728:12345-0@lo:502: 00000100:00100000:2.0:1787787241.939566:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+18:7975:x1874630694425728:12345-0@lo:502: Request processed in 277us (1802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787241.939573:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000004:00080000:1.0:1787787241.940741:0:7977:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787787241.940916:0:7977:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 154167476779ns, next at 0ns, rc = 0 00000100:00100000:0.0:1787787241.942129:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787787241.942149:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874630694425856:12345-0@lo:400: 00000100:00100000:0.0:1787787241.942289:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874630694425856:12345-0@lo:400: Request processed in 148us (4360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787241.942298:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787787241.942320:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787787241.942327:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874630694426240:12345-0@lo:400: 00000100:00100000:0.0:1787787241.943836:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874630694426240:12345-0@lo:400: Request processed in 1496us (5837us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787241.943852:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787787241.943887:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787787241.943901:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694425984:12345-0@lo:400: 00000100:00100000:0.0:1787787241.943968:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694425984:12345-0@lo:400: Request processed in 73us (5934us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787241.943984:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1787787241.944049:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d071b1dc000 x1874630694425984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787787241.944058:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d071b1dcf00 x1874630694426240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787241.944075:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694425984:0@lo:400: 00000100:00100000:0.0:1787787241.944075:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1874630694426240:0@lo:400: 00010000:00080000:0.0:1787787241.944098:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d071b1dda40 x1874630694425856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787241.944108:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874630694425856:0@lo:400: 00000100:00100000:0.0:1787787241.944210:0:7975:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1de1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:7975:1874630694425728:0@lo:502: 00000020:01000000:0.0:1787787241.944252:0:7975:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787241.944261:0:7975:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787241.944263:0:7975:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787787241.944269:0:7975:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1787787241.947059:0:5817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1787787241.947107:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787787241.947121:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d072212bc00/0xdeb1953cba4b0fff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b1006 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787241.947160:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d072212bc00/0xdeb1953cba4b0fff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b1006 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787241.947173:0:5817:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787787241.947176:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9d0703128000 from 1 10000000:01000000:2.0:1787787241.947878:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787787241.947943:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0701647800/0xdeb1953cba4b1029 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787241.947955:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d0701647800/0xdeb1953cba4b1029 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787241.947968:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d0701647800/0xdeb1953cba4b1029 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787241.948009:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1230c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694426368:0@lo:101: 00000100:00100000:2.0:1787787241.948095:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787241.948147:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070860f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787241.951543:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694426368 00000100:00100000:2.0:1787787241.951562:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694426368 00000100:00100000:3.0:1787787241.957916:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787787241.957932:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703090850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+18:5817:x1874630694426368:12345-0@lo:101: 00010000:00010000:3.0:1787787241.957964:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787241.959255:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0708771e00/0xdeb1953cba4b1030 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b1029 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787241.959299:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0708771e00/0xdeb1953cba4b1030 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b1029 expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787241.959313:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0708771e00/0xdeb1953cba4b1030 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b1029 expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787241.959323:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708771e00, rc 0) 00000100:00100000:3.0:1787787241.959414:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703090850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:5817:x1874630694426368:12345-0@lo:101: Request processed in 1486us (11318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787241.959422:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787787241.960771:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1230c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694426368:0@lo:101: 00010000:00010000:0.0:1787787241.960813:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d0701647800/0xdeb1953cba4b1029 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b1030 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787241.960841:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d0701647800/0xdeb1953cba4b1029 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b1030 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787241.960963:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1de1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694426496:0@lo:501: 00000100:00100000:0.0:1787787241.961429:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787241.961619:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070311e480 going to sleep for 11 seconds 00000100:00100000:2.0:1787787241.962086:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694426496 00000100:00100000:2.0:1787787241.962096:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694426496 00000100:00100000:2.0:1787787241.962168:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787787241.962179:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:5817:x1874630694426496:12345-0@lo:501: 00000100:00100000:2.0:1787787241.962651:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:5817:x1874630694426496:12345-0@lo:501: Request processed in 472us (1223us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787787241.962660:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787787241.963245:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1de1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694426496:0@lo:501: 10000000:01000000:0.0:1787787241.963307:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787787241.963321:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0701647800/0xdeb1953cba4b1029 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b1030 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787241.963343:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d0701647800/0xdeb1953cba4b1029 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b1030 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787787242.019475:0:5842:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1787787242.082318:0:7978:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787787242.082495:0:7978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e4a940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7978:1874630694426752:0@lo:7: 00000100:00100000:3.0:1787787242.083485:0:7978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787242.083561:0:7978:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0737e603c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787242.083807:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694426752 00000100:00100000:1.0:1787787242.083817:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694426752 00000100:00100000:1.0:1787787242.083888:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787787242.083901:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e4a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7978:x1874630694426752:12345-0@lo:7: 00000100:00100000:3.0:1787787242.083912:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694426624:0@lo:13: 00000100:00100000:3.0:1787787242.083962:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787242.084013:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694426624 00000100:00100000:3.0:1787787242.084018:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694426624 00000100:00100000:3.0:1787787242.084055:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787787242.084063:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1874630694426624:12345-0@lo:13: 00002000:00000024:3.0:1787787242.084094:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1787787242.084150:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1874630694426624:12345-0@lo:13: Request processed in 88us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787242.084158:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787787242.084234:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0737e48780 x1874630694426624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787242.084258:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694426624:0@lo:13: 00000100:00080000:3.0:1787787242.085086:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:1.0:1787787242.090096:0:6673:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1787787242.090107:0:6673:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787787242.090248:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e4a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7978:x1874630694426752:12345-0@lo:7: Request processed in 6344us (6762us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787242.090260:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787787242.091272:0:7978:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0737e4a940 x1874630694426752/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787787258 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787242.091294:0:7978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e4a940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7978:1874630694426752:0@lo:7: 00000004:00080000:3.0:1787787242.091313:0:7978:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787787242.091389:0:7978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e4a940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7978:1874630694426880:0@lo:5: 00000100:00100000:3.0:1787787242.091475:0:7978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787242.091535:0:7978:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0737e603c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787242.091772:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694426880 00000100:00100000:0.0:1787787242.091782:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694426880 00000100:00100000:3.0:1787787242.091850:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787787242.091864:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e48780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7978:x1874630694426880:12345-0@lo:5: 00002000:00080000:3.0:1787787242.091898:0:6675:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787787242.091904:0:6675:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787787242.092804:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e48780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7978:x1874630694426880:12345-0@lo:5: Request processed in 939us (1323us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787787242.092816:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787787242.092871:0:7978:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0737e4a940 x1874630694426880/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787787258 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787242.092889:0:7978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e4a940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7978:1874630694426880:0@lo:5: 00000004:00080000:3.0:1787787242.092903:0:7978:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787787242.092944:0:7978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e4b840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7978:1874630694427008:0@lo:700: 00000100:00100000:3.0:1787787242.092982:0:7978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787242.093013:0:7978:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0737e603c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787242.093036:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694427008 00000100:00100000:3.0:1787787242.093042:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694427008 00000100:00100000:3.0:1787787242.093079:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787787242.093087:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7978:x1874630694427008:12345-0@lo:700: 00000100:00100000:3.0:1787787242.093122:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e48000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6681:1874630694427136:0@lo:700: 00000100:00100000:3.0:1787787242.093152:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787242.093168:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0737e60c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787787242.094350:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694427136 00000100:00100000:1.0:1787787242.094365:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694427136 00000100:00100000:1.0:1787787242.094424:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787787242.094433:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6681:x1874630694427136:12345-0@lo:700: 00000100:00080000:3.0:1787787242.102682:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787787242.108762:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:1.0:1787787242.132784:0:5826:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1787787242.142503:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6681:x1874630694427136:12345-0@lo:700: Request processed in 48058us (49336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787242.142531:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787787242.145794:0:6681:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0737e48000 x1874630694427136/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787787258 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787242.145820:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e48000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6681:1874630694427136:0@lo:700: 40000000:02000000:1.0:1787787242.145839:0:6681:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:0.0:1787787242.273062:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787787242.273083:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:1.0:1787787242.273283:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7978:x1874630694427008:12345-0@lo:700: Request processed in 180190us (180295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787242.273301:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787787242.273349:0:7978:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0737e4b840 x1874630694427008/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787787258 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787242.273364:0:7978:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787787242.273385:0:7978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e4b840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7978:1874630694427008:0@lo:700: 00000004:02000040:1.0:1787787242.311146:0:7978:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1787787242.315114:0:7978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e44b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7978:1874630694427264:0@lo:5: 00000100:00100000:1.0:1787787242.315228:0:7978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787242.315393:0:7978:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0734690480 going to sleep for 11 seconds 00000100:00100000:2.0:1787787242.315405:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694427264 00000100:00100000:2.0:1787787242.315431:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694427264 00000100:00100000:2.0:1787787242.315525:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787787242.315535:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e47c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7978:x1874630694427264:12345-0@lo:5: 00002000:00080000:3.0:1787787242.322966:0:6673:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787787242.322995:0:6673:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1787787242.328143:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e47c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7978:x1874630694427264:12345-0@lo:5: Request processed in 12596us (12902us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787787242.328160:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787787242.328232:0:7978:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0737e44b40 x1874630694427264/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787787258 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787242.328259:0:7978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e44b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7978:1874630694427264:0@lo:5: 00000004:00080000:2.0:1787787242.328278:0:7978:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1787787243.132841:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787243.389593:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787787243.390991:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694427392:0@lo:13: 00000100:00100000:0.0:1787787243.391059:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787243.391184:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694427392 00000100:00100000:2.0:1787787243.391192:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694427392 00000100:00100000:2.0:1787787243.391259:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787787243.391268:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694427392:12345-0@lo:13: 00002000:00000024:2.0:1787787243.391300:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787243.391356:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694427392:12345-0@lo:13: Request processed in 89us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787243.391363:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1787787243.391479:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787787243.391508:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0737e45a40 x1874630694427392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787259 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787243.391528:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694427392:0@lo:13: 00010000:00010000:0.0:1787787244.156837:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787245.183011:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787246.204520:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787787246.569149:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1787787246.975372:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b123c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694427520:0@lo:400: 00000100:00100000:1.0:1787787246.975465:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787246.975518:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b121e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1874630694428032:0@lo:400: 00000100:00100000:1.0:1787787246.975543:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787246.975568:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787787246.975574:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b120b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694427904:0@lo:400: 00000100:00100000:1.0:1787787246.975598:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787246.975627:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694427904 00000100:00100000:1.0:1787787246.975634:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694427904 00000100:00100000:1.0:1787787246.975696:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787787246.975707:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694427904:12345-0@lo:400: 00000100:00100000:1.0:1787787246.975764:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694427904:12345-0@lo:400: Request processed in 58us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787246.975782:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787787246.975831:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d071b120b40 x1874630694427904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787246.975844:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b120b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694427904:0@lo:400: 00000100:00100000:2.0:1787787246.975917:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694427520 00000100:00100000:2.0:1787787246.975921:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694427520 00000100:00100000:2.0:1787787246.975954:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787787246.975961:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3292:x1874630694427520:12345-0@lo:400: 00000100:00100000:2.0:1787787246.975998:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3292:x1874630694427520:12345-0@lo:400: Request processed in 38us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787246.976004:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787787246.976317:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b123c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694427520:0@lo:400: 00000100:00100000:0.0:1787787246.977100:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694428032 00000100:00100000:0.0:1787787246.977108:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694428032 00000100:00100000:0.0:1787787246.977146:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787787246.977232:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1874630694428032:12345-0@lo:400: 00000100:00100000:0.0:1787787246.977285:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1874630694428032:12345-0@lo:400: Request processed in 132us (1740us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787246.977291:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1787787246.977310:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787787246.977314:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787787246.977348:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d071b121e00 x1874630694428032/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787246.977459:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b121e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1874630694428032:0@lo:400: 00000100:00100000:3.0:1787787246.978056:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b120f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874630694427648:0@lo:400: 00000100:00100000:3.0:1787787246.978102:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787246.978124:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694428160:0@lo:400: 00000100:00100000:3.0:1787787246.978148:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787246.978255:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694427648 00000100:00100000:0.0:1787787246.978261:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694427648 00000100:00100000:0.0:1787787246.978293:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787787246.978300:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e4a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874630694427648:12345-0@lo:400: 00000100:00100000:0.0:1787787246.978338:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e4a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874630694427648:12345-0@lo:400: Request processed in 38us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787246.978344:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1787787246.979067:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d071b120f00 x1874630694427648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787246.979080:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b120f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874630694427648:0@lo:400: 00000100:00100000:3.0:1787787246.979094:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787787246.979117:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1874630694427776:0@lo:400: 00000100:00100000:3.0:1787787246.979148:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787246.979277:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694428160 00000100:00100000:3.0:1787787246.979282:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694428160 00000100:00100000:3.0:1787787246.979360:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787787246.979378:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e48f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694428160:12345-0@lo:400: 00000100:00100000:3.0:1787787246.979416:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e48f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694428160:12345-0@lo:400: Request processed in 50us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787246.979422:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787787246.979463:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d071b1221c0 x1874630694428160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787246.979483:0:3293:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787787246.979494:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694428160:0@lo:400: 00000100:00100000:0.0:1787787246.980819:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694427776 00000100:00100000:0.0:1787787246.980828:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694427776 00000100:00080000:1.0:1787787246.982087:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787787246.982094:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787787246.984410:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787787246.984423:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874630694427776:12345-0@lo:400: 00000100:00100000:0.0:1787787246.984538:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874630694427776:12345-0@lo:400: Request processed in 118us (5388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787246.984545:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1787787246.984609:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d071b120000 x1874630694427776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787246.984625:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1874630694427776:0@lo:400: 00000100:00100000:2.0:1787787247.013021:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787247.013171:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678675584 00000100:00100000:3.0:1787787247.013181:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678675584 00000100:00100000:3.0:1787787247.013218:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 112 00000100:00100000:3.0:1787787247.013226:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703090050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2341:x1874630678675584:12345-192.168.206.10@tcp:250: 00010000:00080000:3.0:1787787247.013252:0:5814:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from af6a8f90-14b7-42f3-a06a-560ac8c8f006@192.168.206.10@tcp t0 exp 0000000000000000 cur 159 last 0 00000020:00000080:3.0:1787787247.013283:0:5814:0:(genops.c:1385:class_connect()) connect: client af6a8f90-14b7-42f3-a06a-560ac8c8f006, cookie 0xdeb1953cba4b1037 00000100:00080000:3.0:1787787247.013630:0:5814:0:(import.c:65:import_set_state_nolock()) ffff9d073472a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787787247.013700:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703090050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+5:2341:x1874630678675584:12345-192.168.206.10@tcp:250: Request processed in 471us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787247.013708:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 112 00000100:00100000:0.0:1787787247.015739:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787247.015808:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678675712 00000100:00100000:3.0:1787787247.015816:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678675712 00000100:00100000:3.0:1787787247.015863:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 113 00000100:00100000:3.0:1787787247.015873:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+5:5569:x1874630678675712:12345-192.168.206.10@tcp:101: 00010000:00010000:3.0:1787787247.015897:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787247.015914:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0708771200/0xdeb1953cba4b103e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c34f3d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787247.015941:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0708771200/0xdeb1953cba4b103e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34f3d expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787247.015952:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0708771200/0xdeb1953cba4b103e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34f3d expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787247.015960:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708771200, rc 0) 00000100:00100000:3.0:1787787247.016011:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+6:5569:x1874630678675712:12345-192.168.206.10@tcp:101: Request processed in 140us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787247.016018:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 113 00000100:00100000:3.0:1787787247.020685:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787247.021010:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678675840 00000100:00100000:1.0:1787787247.021020:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678675840 00000100:00100000:1.0:1787787247.021075:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 114 00000100:00100000:1.0:1787787247.021085:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+6:5569:x1874630678675840:12345-192.168.206.10@tcp:501: 00000100:00100000:1.0:1787787247.025322:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+6:5569:x1874630678675840:12345-192.168.206.10@tcp:501: Request processed in 4226us (4634us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787787247.025337:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 114 00000100:00100000:0.0:1787787247.032699:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787247.033324:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678675968 00000100:00100000:3.0:1787787247.033335:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678675968 00000100:00100000:3.0:1787787247.033473:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 115 00000100:00100000:3.0:1787787247.033485:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+6:5569:x1874630678675968:12345-192.168.206.10@tcp:101: 00010000:00010000:3.0:1787787247.033501:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787247.033518:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0708771400/0xdeb1953cba4b1045 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c34f44 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787247.033547:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0708771400/0xdeb1953cba4b1045 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34f44 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787247.033558:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0708771400/0xdeb1953cba4b1045 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34f44 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787247.033586:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708771400, rc 0) 00000100:00100000:3.0:1787787247.033639:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+7:5569:x1874630678675968:12345-192.168.206.10@tcp:101: Request processed in 157us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787247.033646:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 115 00000100:00100000:0.0:1787787247.051904:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787247.052177:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678676096 00000100:00100000:3.0:1787787247.052187:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678676096 00000100:00100000:3.0:1787787247.052237:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 116 00000100:00100000:3.0:1787787247.052246:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+7:5569:x1874630678676096:12345-192.168.206.10@tcp:501: 00000100:00100000:3.0:1787787247.052533:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+8:5569:x1874630678676096:12345-192.168.206.10@tcp:501: Request processed in 286us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787247.052541:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 116 00000100:00100000:3.0:1787787247.054504:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787247.054623:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678676224 00000100:00100000:1.0:1787787247.054632:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678676224 00000100:00100000:1.0:1787787247.054678:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 117 00000100:00100000:1.0:1787787247.054688:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+8:5569:x1874630678676224:12345-192.168.206.10@tcp:503: 00000100:00100000:1.0:1787787247.054966:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+8:5569:x1874630678676224:12345-192.168.206.10@tcp:503: Request processed in 278us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787247.054973:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 117 00000100:00100000:1.0:1787787247.060484:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787247.060970:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678676352 00000100:00100000:3.0:1787787247.060980:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678676352 00000100:00100000:3.0:1787787247.061035:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 118 00000100:00100000:3.0:1787787247.061046:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+8:5587:x1874630678676352:12345-192.168.206.10@tcp:502: 00000100:00100000:3.0:1787787247.061363:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+8:5587:x1874630678676352:12345-192.168.206.10@tcp:502: Request processed in 317us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787247.061384:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 118 00000100:00100000:1.0:1787787247.099266:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787247.100339:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678676480 00000100:00100000:3.0:1787787247.100351:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678676480 00000100:00100000:3.0:1787787247.101272:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 119 00000100:00100000:3.0:1787787247.101284:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+8:5587:x1874630678676480:12345-192.168.206.10@tcp:502: 00000100:00100000:3.0:1787787247.101952:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+8:5587:x1874630678676480:12345-192.168.206.10@tcp:502: Request processed in 668us (2692us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787247.101970:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 119 00000100:00100000:3.0:1787787247.106041:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787247.106130:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678676608 00000100:00100000:0.0:1787787247.106139:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678676608 00000100:00100000:0.0:1787787247.106196:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 120 00000100:00100000:0.0:1787787247.106204:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+8:5569:x1874630678676608:12345-192.168.206.10@tcp:101: 00010000:00010000:0.0:1787787247.106235:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787247.106251:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0700031600/0xdeb1953cba4b104c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c34f6e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787247.106277:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0700031600/0xdeb1953cba4b104c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34f6e expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787247.106289:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0700031600/0xdeb1953cba4b104c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34f6e expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787247.106298:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0700031600, rc 0) 00000100:00100000:0.0:1787787247.106349:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+9:5569:x1874630678676608:12345-192.168.206.10@tcp:101: Request processed in 145us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787247.106356:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 120 00000100:00100000:3.0:1787787247.111361:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787247.111407:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678676736 00000100:00100000:3.0:1787787247.111416:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678676736 00000100:00100000:3.0:1787787247.111479:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 121 00000100:00100000:3.0:1787787247.111489:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+9:5569:x1874630678676736:12345-192.168.206.10@tcp:256: 20000000:01000000:3.0:1787787247.111513:0:5812:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787787247.111532:0:5812:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787787247.111537:0:5812:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787787247.111553:0:5812:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787787247.111556:0:5812:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1787787247.115350:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+9:5569:x1874630678676736:12345-192.168.206.10@tcp:256: Request processed in 3853us (3988us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787247.115387:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 121 00000100:00100000:0.0:1787787247.129840:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787247.129871:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678676864 00000100:00100000:0.0:1787787247.129880:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678676864 00000100:00100000:0.0:1787787247.129922:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 122 00000100:00100000:0.0:1787787247.129931:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+9:5569:x1874630678676864:12345-192.168.206.10@tcp:101: 00010000:00010000:0.0:1787787247.129946:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787247.129961:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0700030800/0xdeb1953cba4b1053 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c34f75 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787247.129987:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0700030800/0xdeb1953cba4b1053 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34f75 expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787247.129998:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0700030800/0xdeb1953cba4b1053 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34f75 expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787247.130019:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0700030800, rc 0) 00000100:00100000:0.0:1787787247.130069:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:5569:x1874630678676864:12345-192.168.206.10@tcp:101: Request processed in 139us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787247.130076:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 122 00000100:00100000:0.0:1787787247.140247:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787247.142358:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678676992 00000100:00100000:2.0:1787787247.142382:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678676992 00000100:00100000:3.0:1787787247.142556:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 123 00000100:00100000:3.0:1787787247.142567:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:5569:x1874630678676992:12345-192.168.206.10@tcp:501: 00000100:00100000:3.0:1787787247.143143:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:5569:x1874630678676992:12345-192.168.206.10@tcp:501: Request processed in 574us (2901us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787247.143161:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 123 00000100:00100000:1.0:1787787247.145135:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787247.145214:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678677120 00000100:00100000:2.0:1787787247.145233:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678677120 00000100:00100000:2.0:1787787247.145278:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 124 00000100:00100000:2.0:1787787247.145286:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:5569:x1874630678677120:12345-192.168.206.10@tcp:503: 00000100:00100000:2.0:1787787247.145647:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:5569:x1874630678677120:12345-192.168.206.10@tcp:503: Request processed in 360us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787247.145656:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 124 00000100:00100000:1.0:1787787247.153282:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787247.153358:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678677248 00000100:00100000:0.0:1787787247.153376:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678677248 00000100:00100000:0.0:1787787247.153425:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 125 00000100:00100000:0.0:1787787247.153434:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:5592:x1874630678677248:12345-192.168.206.10@tcp:502: 00000100:00100000:0.0:1787787247.153707:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:5592:x1874630678677248:12345-192.168.206.10@tcp:502: Request processed in 272us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787247.154145:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 125 00000100:00100000:2.0:1787787247.158517:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787247.158598:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678677376 00000100:00100000:0.0:1787787247.158608:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678677376 00000100:00100000:0.0:1787787247.158658:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 126 00000100:00100000:0.0:1787787247.158668:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:5592:x1874630678677376:12345-192.168.206.10@tcp:502: 00000100:00100000:0.0:1787787247.158889:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:5592:x1874630678677376:12345-192.168.206.10@tcp:502: Request processed in 222us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787247.158897:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 126 00000100:00100000:2.0:1787787247.165681:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787247.166687:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678677504 00000100:00100000:1.0:1787787247.166700:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678677504 00000100:00100000:1.0:1787787247.167112:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:1.0:1787787247.167121:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2341:x1874630678677504:12345-192.168.206.10@tcp:38: 00010000:00080000:1.0:1787787247.167147:0:5819:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c5599457-aa74-4a71-951f-faabe33e6ec7@192.168.206.10@tcp t0 exp 0000000000000000 cur 159 last 0 00000020:00000080:1.0:1787787247.167200:0:5819:0:(genops.c:1385:class_connect()) connect: client c5599457-aa74-4a71-951f-faabe33e6ec7, cookie 0xdeb1953cba4b105a 00000004:00100000:1.0:1787787247.167227:0:5819:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1787787247.167232:0:5819:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1787787247.207175:0:5819:0:(import.c:65:import_set_state_nolock()) ffff9d073ff97000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787787247.207255:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2341:x1874630678677504:12345-192.168.206.10@tcp:38: Request processed in 40134us (41582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787247.207266:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 4 00010000:00010000:3.0:1787787247.228588:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787247.484912:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787787247.484935:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b121680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694428288:0@lo:13: 00000100:00100000:0.0:1787787247.485013:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787247.485177:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694428288 00000100:00100000:2.0:1787787247.485185:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694428288 00000100:00100000:2.0:1787787247.485239:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787787247.485249:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694428288:12345-0@lo:13: 00002000:00000024:2.0:1787787247.485281:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787247.485333:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694428288:12345-0@lo:13: Request processed in 85us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787247.485341:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787787247.485386:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d071b121680 x1874630694428288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787247.485403:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b121680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694428288:0@lo:13: 00000100:00100000:1.0:1787787248.213977:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787248.214085:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787248.216327:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678677760 00000100:00100000:2.0:1787787248.216341:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678677760 00000100:00100000:2.0:1787787248.216423:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678677632 00000100:00100000:2.0:1787787248.216427:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678677632 00000100:00100000:2.0:1787787248.216481:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:2.0:1787787248.216492:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+7:5569:x1874630678677760:12345-192.168.206.10@tcp:41: 00000004:00000024:2.0:1787787248.216531:0:5821:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787787248.216609:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+7:5569:x1874630678677760:12345-192.168.206.10@tcp:41: Request processed in 119us (2646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787248.216617:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:2.0:1787787248.216633:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:2.0:1787787248.216652:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+6:0:x1874630678677632:12345-192.168.206.10@tcp:41: 00000004:00000024:2.0:1787787248.216663:0:5821:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787787248.216685:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+6:0:x1874630678677632:12345-192.168.206.10@tcp:41: Request processed in 34us (2600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787248.216691:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00080000:1.0:1787787248.217729:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787248.222862:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787248.223229:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678677888 00000100:00100000:1.0:1787787248.223242:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678677888 00000100:00100000:1.0:1787787248.223320:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:1.0:1787787248.223332:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:5569:x1874630678677888:12345-192.168.206.10@tcp:40: 00000100:00100000:1.0:1787787248.223491:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:5569:x1874630678677888:12345-192.168.206.10@tcp:40: Request processed in 160us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787248.223500:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:0.0:1787787248.228402:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787248.231101:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678678272 00000100:00100000:1.0:1787787248.231140:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678678272 00000100:00100000:1.0:1787787248.231249:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:1.0:1787787248.231261:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:5569:x1874630678678272:12345-192.168.206.10@tcp:33: 00000100:00100000:0.0:1787787248.232572:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787248.232620:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787248.232657:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787248.232691:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678678400 00000100:00100000:0.0:1787787248.232700:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678678400 00000100:00100000:0.0:1787787248.232747:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 127 00000100:00100000:0.0:1787787248.232757:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:2343:x1874630678678400:12345-192.168.206.10@tcp:400: 00000100:00100000:0.0:1787787248.232853:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:2343:x1874630678678400:12345-192.168.206.10@tcp:400: Request processed in 97us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787248.232862:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 127 00000100:00100000:3.0:1787787248.233021:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678678016 00000100:00100000:3.0:1787787248.233027:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678678016 00000100:00100000:3.0:1787787248.233064:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678678144 00000100:00100000:3.0:1787787248.233067:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678678144 00000100:00100000:1.0:1787787248.233079:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:1.0:1787787248.233086:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2341:x1874630678678016:12345-192.168.206.10@tcp:8: 00010000:00080000:1.0:1787787248.233115:0:6673:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c5599457-aa74-4a71-951f-faabe33e6ec7@192.168.206.10@tcp t0 exp 0000000000000000 cur 160 last 0 00000020:00000080:1.0:1787787248.233164:0:6673:0:(genops.c:1385:class_connect()) connect: client c5599457-aa74-4a71-951f-faabe33e6ec7, cookie 0xdeb1953cba4b1061 00002000:00100000:1.0:1787787248.233180:0:6673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c5599457-aa74-4a71-951f-faabe33e6ec7/ffff9d073d8ab800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113934 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787787248.233211:0:6673:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787787248.233774:0:6673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787787248.233826:0:6673:0:(import.c:65:import_set_state_nolock()) ffff9d073d8aa800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787787248.233878:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2341:x1874630678678016:12345-192.168.206.10@tcp:8: Request processed in 789us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787248.238138:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:1.0:1787787248.238210:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:1.0:1787787248.238221:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2341:x1874630678678144:12345-192.168.206.10@tcp:8: 00010000:00080000:1.0:1787787248.238271:0:6673:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c5599457-aa74-4a71-951f-faabe33e6ec7@192.168.206.10@tcp t0 exp 0000000000000000 cur 160 last 0 00000020:00000080:1.0:1787787248.238316:0:6673:0:(genops.c:1385:class_connect()) connect: client c5599457-aa74-4a71-951f-faabe33e6ec7, cookie 0xdeb1953cba4b1068 00002000:00100000:1.0:1787787248.238335:0:6673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c5599457-aa74-4a71-951f-faabe33e6ec7/ffff9d073d8ab000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113934 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787787248.238349:0:6673:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787787248.238790:0:6673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787787248.241191:0:6673:0:(import.c:65:import_set_state_nolock()) ffff9d073d8ae800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787787248.242111:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2341:x1874630678678144:12345-192.168.206.10@tcp:8: Request processed in 3880us (9478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787248.242162:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 9 00010000:00010000:2.0:1787787248.268964:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787787248.270081:0:5822:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 38705us 00000004:00200000:0.0:1787787248.294796:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787787248.295237:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:5569:x1874630678678272:12345-192.168.206.10@tcp:33: Request processed in 63969us (66839us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787248.295255:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:2.0:1787787248.493185:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787248.493386:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678678528 00000100:00100000:3.0:1787787248.493399:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678678528 00000100:00100000:3.0:1787787248.493528:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:3.0:1787787248.493541:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b121680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+6:5610:x1874630678678528:12345-192.168.206.10@tcp:101: 00010000:00010000:3.0:1787787248.493566:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787248.493759:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770c00/0xdeb1953cba4b106f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c34f9f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.493846:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1076 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.494572:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1076 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.494593:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1076 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787248.494795:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787787248.494800:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787787248.494881:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1076 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.494913:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770c00/0xdeb1953cba4b106f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34f9f expref: 8 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.494930:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1076 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34f9f expref: 7 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787248.494938:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d071b71df00) 00010000:00010000:3.0:1787787248.494941:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787787248.494944:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708770600, rc 0) 00000100:00100000:3.0:1787787248.495026:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b121680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+7:5610:x1874630678678528:12345-192.168.206.10@tcp:101: Request processed in 1487us (1853us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787248.497190:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:3.0:1787787248.508720:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073475ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694428416:0@lo:13: 00000100:00100000:3.0:1787787248.508795:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787248.509014:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694428416 00000100:00100000:2.0:1787787248.509038:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694428416 00000100:00080000:1.0:1787787248.509124:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787248.509132:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787787248.509157:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694428416:12345-0@lo:13: 00002000:00000024:2.0:1787787248.509182:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787248.510664:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694428416:12345-0@lo:13: Request processed in 1515us (1861us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787248.510677:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787787248.510801:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d073475ed00 x1874630694428416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787264 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787248.510823:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073475ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694428416:0@lo:13: 00000001:00100000:2.0:1787787249.081417:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c5599457-aa74-4a71-951f-faabe33e6ec7 00010000:00010000:3.0:1787787249.276696:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787250.302048:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787250.461636:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787250.461965:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678678656 00000100:00100000:0.0:1787787250.461980:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678678656 00000100:00100000:0.0:1787787250.462082:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:0.0:1787787250.462094:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+7:5662:x1874630678678656:12345-192.168.206.10@tcp:41: 00000004:00000024:0.0:1787787250.462160:0:5821:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787787250.462303:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+7:5662:x1874630678678656:12345-192.168.206.10@tcp:41: Request processed in 211us (1539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787250.462312:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00080000:1.0:1787787250.462955:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787250.474213:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787250.476987:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678678784 00000100:00100000:1.0:1787787250.477007:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678678784 00000100:00100000:1.0:1787787250.477296:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:1.0:1787787250.477310:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c5599457-aa74-4a71-951f-faabe33e6ec7+5:5662:x1874630678678784:12345-192.168.206.10@tcp:13: 00002000:00000024:1.0:1787787250.477360:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787787250.477483:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c5599457-aa74-4a71-951f-faabe33e6ec7+5:5662:x1874630678678784:12345-192.168.206.10@tcp:13: Request processed in 176us (3285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787250.477492:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00080000:2.0:1787787250.478010:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787787250.482711:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787250.483016:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678678912 00000100:00100000:1.0:1787787250.483028:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678678912 00000100:00100000:1.0:1787787250.483119:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:1.0:1787787250.483130:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e4b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c5599457-aa74-4a71-951f-faabe33e6ec7+6:5662:x1874630678678912:12345-192.168.206.10@tcp:13: 00002000:00000024:1.0:1787787250.483190:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787787250.483281:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e4b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c5599457-aa74-4a71-951f-faabe33e6ec7+6:5662:x1874630678678912:12345-192.168.206.10@tcp:13: Request processed in 152us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787250.483289:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00080000:2.0:1787787250.483706:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787787251.326060:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787252.093260:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694428928:0@lo:400: 00000100:00100000:3.0:1787787252.093328:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787252.093405:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787787252.093412:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694428544:0@lo:400: 00000100:00100000:3.0:1787787252.093470:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787252.093494:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e45680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1874630694429056:0@lo:400: 00000100:00100000:3.0:1787787252.093519:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787252.093544:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1874630694428800:0@lo:400: 00000100:00100000:3.0:1787787252.093568:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787252.093588:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787787252.093593:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874630694428672:0@lo:400: 00000100:00100000:3.0:1787787252.093615:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787252.093631:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694429184:0@lo:400: 00000100:00100000:3.0:1787787252.093651:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787252.093676:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694428544 00000100:00100000:3.0:1787787252.093682:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694428544 00000100:00100000:3.0:1787787252.093724:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787787252.093733:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3291:x1874630694428544:12345-0@lo:400: 00000100:00100000:3.0:1787787252.093778:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3291:x1874630694428544:12345-0@lo:400: Request processed in 46us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787252.093798:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787787252.093830:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694429056 00000100:00100000:3.0:1787787252.093833:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694429056 00000100:00100000:3.0:1787787252.093862:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694428800 00000100:00100000:3.0:1787787252.093865:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694428800 00000100:00100000:3.0:1787787252.093878:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694428672 00000100:00100000:3.0:1787787252.093880:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694428672 00000100:00100000:3.0:1787787252.093893:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787787252.093899:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07222512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1874630694429056:12345-0@lo:400: 00000100:00100000:3.0:1787787252.093930:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07222512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1874630694429056:12345-0@lo:400: Request processed in 31us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787252.093936:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787787252.093949:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787787252.093955:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0722251e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1874630694428800:12345-0@lo:400: 00000100:00100000:3.0:1787787252.093986:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0722251e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1874630694428800:12345-0@lo:400: Request processed in 32us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787252.093992:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787787252.094009:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787787252.094016:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07222a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874630694428672:12345-0@lo:400: 00000100:00100000:3.0:1787787252.094042:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07222a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874630694428672:12345-0@lo:400: Request processed in 27us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787252.094048:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787787252.094071:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694428928 00000100:00100000:3.0:1787787252.094074:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694428928 00000100:00100000:3.0:1787787252.094097:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694429184 00000100:00100000:3.0:1787787252.094100:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694429184 00000100:00100000:3.0:1787787252.094116:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787787252.094122:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694428928:12345-0@lo:400: 00000100:00100000:3.0:1787787252.094240:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694428928:12345-0@lo:400: Request processed in 118us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787252.094246:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787787252.094259:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787787252.094265:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07222a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694429184:12345-0@lo:400: 00000100:00100000:3.0:1787787252.094293:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07222a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694429184:12345-0@lo:400: Request processed in 29us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787252.094299:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1787787252.094318:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787787252.094322:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787787252.094324:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787252.094350:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874630694428672:0@lo:400: 00010000:00080000:3.0:1787787252.094363:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0737e46d00 x1874630694429184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787252.094374:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694429184:0@lo:400: 00000100:00100000:3.0:1787787252.094384:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1874630694428800:0@lo:400: 00000100:00100000:3.0:1787787252.094414:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694428544:0@lo:400: 00000100:00100000:3.0:1787787252.094425:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e45680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1874630694429056:0@lo:400: 00010000:00080000:3.0:1787787252.094434:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0737e44780 x1874630694428928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787252.094470:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694428928:0@lo:400: 00010000:00010000:1.0:1787787252.349695:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787252.613397:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694429312:0@lo:13: 00000100:00100000:1.0:1787787252.613487:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787252.613823:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694429312 00000100:00100000:1.0:1787787252.613832:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694429312 00000100:00100000:1.0:1787787252.613878:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787787252.613886:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e45680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694429312:12345-0@lo:13: 00002000:00000024:1.0:1787787252.613929:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787787252.613976:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e45680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694429312:12345-0@lo:13: Request processed in 90us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787252.613983:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1787787252.614368:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0737e44780 x1874630694429312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787268 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787252.614388:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694429312:0@lo:13: 00000001:00100000:2.0:1787787252.670225:0:5842:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c5599457-aa74-4a71-951f-faabe33e6ec7 00000001:00100000:3.0:1787787252.683282:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c5599457-aa74-4a71-951f-faabe33e6ec7 00000001:02000400:3.0:1787787252.981158:0:8285:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787787253.373412:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787253.632539:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073475f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694429440:0@lo:13: 00000100:00100000:3.0:1787787253.632605:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787253.633301:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694429440 00000100:00100000:2.0:1787787253.633310:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694429440 00000100:00100000:2.0:1787787253.633362:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787787253.633371:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07222a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694429440:12345-0@lo:13: 00002000:00000024:2.0:1787787253.633405:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787253.636740:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07222a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694429440:12345-0@lo:13: Request processed in 3360us (4125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787253.636754:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1787787253.639338:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d073475f480 x1874630694429440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787269 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787253.639367:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073475f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694429440:0@lo:13: 00000100:00100000:3.0:1787787253.739857:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787253.739904:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787253.739948:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787253.739984:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787253.740013:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678679168 00000100:00100000:3.0:1787787253.740021:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678679168 00000100:00100000:3.0:1787787253.740073:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 24 00000100:00100000:3.0:1787787253.740084:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2344:x1874630678679168:12345-192.168.206.10@tcp:400: 00000100:00100000:3.0:1787787253.740168:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2344:x1874630678679168:12345-192.168.206.10@tcp:400: Request processed in 87us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787253.740175:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 24 00000100:00080000:3.0:1787787253.740198:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787253.740793:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678679040 00000100:00100000:0.0:1787787253.740805:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678679040 00000100:00100000:0.0:1787787253.740836:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 129 00000100:00100000:0.0:1787787253.740843:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:2344:x1874630678679040:12345-192.168.206.10@tcp:400: 00000100:00100000:0.0:1787787253.740878:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:2344:x1874630678679040:12345-192.168.206.10@tcp:400: Request processed in 36us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787253.740884:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 129 00000100:00100000:1.0:1787787253.741287:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678679296 00000100:00100000:1.0:1787787253.741292:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678679296 00000100:00100000:1.0:1787787253.741339:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678679424 00000100:00100000:1.0:1787787253.741342:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678679424 00000100:00100000:1.0:1787787253.741360:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:1.0:1787787253.741368:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2344:x1874630678679296:12345-192.168.206.10@tcp:400: 00000100:00100000:1.0:1787787253.741412:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2344:x1874630678679296:12345-192.168.206.10@tcp:400: Request processed in 45us (1507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787253.741419:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:1.0:1787787253.741431:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:1.0:1787787253.741461:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2344:x1874630678679424:12345-192.168.206.10@tcp:400: 00000100:00100000:1.0:1787787253.741500:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2344:x1874630678679424:12345-192.168.206.10@tcp:400: Request processed in 63us (1515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787253.741517:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00080000:3.0:1787787253.742283:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787787253.742288:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787787254.396661:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787255.421512:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787256.444761:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787787256.902347:0:8434:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd223b3a10 20000000:00000080:0.0:1787787256.902368:0:8434:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d073c6fa800 uarg=0000000000000000 20000000:01000000:0.0:1787787256.902415:0:8434:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1787787256.902418:0:8434:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1787787256.902421:0:8434:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787787256.902426:0:8434:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787787256.902432:0:8434:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1787787256.902624:0:8434:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787787256.902628:0:8434:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787787256.902856:0:8434:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787787256.902859:0:8434:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787787256.904566:0:8435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1787787256.905169:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1787787256.905245:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1787787256.905283:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1787787256.905297:0:8434:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787787256.905300:0:8434:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787787256.907647:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1787787256.908337:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1787787256.908394:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1787787256.908509:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1787787256.908526:0:8434:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787787256.908529:0:8434:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787787256.910720:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1787787256.911601:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1787787256.911661:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1787787256.911698:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1787787256.911713:0:8434:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787787256.911725:0:8434:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787787256.913523:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1787787256.921081:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1787787256.921178:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1787787256.921218:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:2.0:1787787256.921238:0:8434:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787787256.921264:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d0701646000/0xdeb1953cba4b107d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.921285:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d072212be00/0xdeb1953cba4b0f7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0f73 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.921294:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0700031800/0xdeb1953cba4b0fa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0f9d expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.921301:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0701647c00/0xdeb1953cba4b0fce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0fc7 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.921308:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d070141f600/0xdeb1953cba4b0fdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0fd5 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.921315:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0701646e00/0xdeb1953cba4b0fea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0fe3 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.921320:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b1006 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0fff expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.921340:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0708771e00/0xdeb1953cba4b1030 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b1029 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.921350:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0708771200/0xdeb1953cba4b103e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34f3d expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.921357:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0708771400/0xdeb1953cba4b1045 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34f44 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.921365:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d0701646000/0xdeb1953cba4b107d lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.921416:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0708771400/0xdeb1953cba4b1045 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34f44 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.921740:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d0708771400/0xdeb1953cba4b1045 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34f44 expref: 9 pid: 5812 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787256.921761:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b123c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874630694429568:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787787256.921902:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0708771200/0xdeb1953cba4b103e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34f3d expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.921912:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d0708771200/0xdeb1953cba4b103e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34f3d expref: 9 pid: 5812 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787256.921921:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b120b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874630694429696:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787787256.922429:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0708771e00/0xdeb1953cba4b1030 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b1029 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.923176:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0708771e00/0xdeb1953cba4b1030 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b1029 expref: 18 pid: 5812 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787256.923193:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b121e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874630694429824:0@lo:104: 00000100:00100000:2.0:1787787256.923398:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787256.924934:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694429824 00000100:00100000:1.0:1787787256.924956:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694429824 00000100:00100000:1.0:1787787256.925155:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787787256.925182:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b120f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1500c007-b35b-4004-b231-bb5a7ec082ef+3:8434:x1874630694429824:12345-0@lo:104: 00010000:00010000:1.0:1787787256.925203:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9d0701647800/0xdeb1953cba4b1029 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b1030 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787256.925300:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787787256.925306:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b120f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1500c007-b35b-4004-b231-bb5a7ec082ef+3:8434:x1874630694429824:12345-0@lo:104: Request processed in 129us (1911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787256.925313:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1787787256.925336:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787256.925342:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d0701647800/0xdeb1953cba4b1029 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b1030 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787256.925350:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0701647800 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:1.0:1787787256.925355:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d0701647800/0xdeb1953cba4b1029 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b1030 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787256.925365:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d0701647800/0xdeb1953cba4b1029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b1030 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787256.925374:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d0701647800/0xdeb1953cba4b1029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b1030 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787256.925381:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787787256.925422:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d0701647800/0xdeb1953cba4b1029 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b1030 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787256.925429:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787256.925486:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d0701647800/0xdeb1953cba4b1029 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b1030 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787256.925504:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d0701647800/0xdeb1953cba4b1029 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b1030 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787256.925520:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787256.925522:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787256.925524:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787256.925660:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b1006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b0fff expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.925674:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b1006 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b0fff expref: 18 pid: 5812 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787256.925688:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a09a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874630694430080:0@lo:104: 00000100:00100000:2.0:1787787256.925739:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787787256.925794:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0701646e00/0xdeb1953cba4b0fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b0fe3 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.925803:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0701646e00/0xdeb1953cba4b0fea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b0fe3 expref: 18 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787256.925811:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874630694430208:0@lo:104: 00010000:00010000:2.0:1787787256.925839:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d070141f600/0xdeb1953cba4b0fdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b0fd5 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.925848:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d070141f600/0xdeb1953cba4b0fdc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b0fd5 expref: 18 pid: 5812 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787256.925856:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0b840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874630694430336:0@lo:104: 00010000:00010000:2.0:1787787256.925879:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0701647c00/0xdeb1953cba4b0fce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b0fc7 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.925893:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0701647c00/0xdeb1953cba4b0fce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b0fc7 expref: 18 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787256.925902:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874630694430464:0@lo:104: 00000100:00100000:3.0:1787787256.926195:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787787256.926218:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787256.926236:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787256.926245:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787256.926251:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694430080 00000100:00100000:3.0:1787787256.926257:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694430080 00000100:00100000:3.0:1787787256.926363:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694430208 00000100:00100000:3.0:1787787256.926367:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694430208 00000100:00100000:3.0:1787787256.926388:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694430336 00000100:00100000:3.0:1787787256.926390:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694430336 00000100:00100000:3.0:1787787256.926399:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694430464 00000100:00100000:3.0:1787787256.926401:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694430464 00000100:00100000:3.0:1787787256.926411:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787787256.926419:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737eb7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+6:8434:x1874630694430080:12345-0@lo:104: 00010000:00010000:3.0:1787787256.926428:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9d072212bc00/0xdeb1953cba4b0fff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b1006 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787256.926498:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787787256.926504:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737eb7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+6:8434:x1874630694430080:12345-0@lo:104: Request processed in 87us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787256.926510:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787787256.926561:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787787256.926568:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+5:8434:x1874630694430208:12345-0@lo:104: 00010000:00010000:3.0:1787787256.926576:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9d0700030000/0xdeb1953cba4b0fe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0fea expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787256.926610:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787787256.926615:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+5:8434:x1874630694430208:12345-0@lo:104: Request processed in 48us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787256.926621:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787787256.926633:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787787256.926639:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+4:8434:x1874630694430336:12345-0@lo:104: 00010000:00010000:3.0:1787787256.926646:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9d072212a000/0xdeb1953cba4b0fd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0fdc expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787256.926671:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787787256.926682:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+4:8434:x1874630694430336:12345-0@lo:104: Request processed in 44us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787256.926687:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787787256.926700:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787787256.926705:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+3:8434:x1874630694430464:12345-0@lo:104: 00010000:00010000:3.0:1787787256.926712:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9d070141e000/0xdeb1953cba4b0fc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0fce expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787256.926739:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787787256.926744:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+3:8434:x1874630694430464:12345-0@lo:104: Request processed in 40us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787256.926750:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787787256.926770:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787787256.926783:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694429952:0@lo:103: 00000100:00100000:3.0:1787787256.926810:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787787256.926890:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787787256.926896:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d072212bc00/0xdeb1953cba4b0fff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b1006 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787256.926904:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212bc00 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:3.0:1787787256.926907:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d072212bc00/0xdeb1953cba4b0fff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b1006 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787256.926915:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d072212bc00/0xdeb1953cba4b0fff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b1006 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787787256.926922:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d072212bc00/0xdeb1953cba4b0fff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b1006 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787256.926950:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787787256.926976:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d072212bc00/0xdeb1953cba4b0fff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b1006 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787256.927804:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694429952 00000100:00100000:0.0:1787787256.927813:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694429952 00010000:00010000:0.0:1787787256.927848:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0708771e00/0xdeb1953cba4b1030 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b1029 expref: 19 pid: 5812 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787256.927876:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787787256.927883:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3291:x1874630694429952:12345-0@lo:103: 00010000:00010000:0.0:1787787256.927897:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787256.927902:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0708771e00/0xdeb1953cba4b1030 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b1029 expref: 19 pid: 5812 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.927913:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0708771e00/0xdeb1953cba4b1030 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b1029 expref: 19 pid: 5812 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.927945:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787256.928014:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3291:x1874630694429952:12345-0@lo:103: Request processed in 132us (1203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787256.928022:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1787787256.928046:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787787256.928256:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787787256.928263:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d0700030000/0xdeb1953cba4b0fe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0fea expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.928271:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0700030000 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:0.0:1787787256.928276:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d0700030000/0xdeb1953cba4b0fe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b0fea expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.928284:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d0700030000/0xdeb1953cba4b0fe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b0fea expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787787256.928301:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d0700030000/0xdeb1953cba4b0fe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b0fea expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787256.928307:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787787256.928336:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d0700030000/0xdeb1953cba4b0fe3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0fea expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.928343:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787787256.928360:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d0700030000/0xdeb1953cba4b0fe3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0fea expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.928369:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d0700030000/0xdeb1953cba4b0fe3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0fea expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.928382:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787256.928386:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d070141e000/0xdeb1953cba4b0fc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0fce expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.928392:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d070141e000 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:0.0:1787787256.928395:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d070141e000/0xdeb1953cba4b0fc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b0fce expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.928401:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d070141e000/0xdeb1953cba4b0fc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b0fce expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787787256.928408:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d070141e000/0xdeb1953cba4b0fc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b0fce expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787256.928413:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787787256.928434:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d070141e000/0xdeb1953cba4b0fc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0fce expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.928472:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787787256.928479:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d070141e000/0xdeb1953cba4b0fc7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0fce expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.928485:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d070141e000/0xdeb1953cba4b0fc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0fce expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.928497:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787256.928498:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787256.928500:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787256.929120:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073475cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694430720:0@lo:103: 00000100:00100000:1.0:1787787256.929182:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787256.929230:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787787256.929237:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073475f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694430848:0@lo:103: 00000100:00100000:1.0:1787787256.929258:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787256.929293:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694430720 00000100:00100000:1.0:1787787256.929299:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694430720 00010000:00010000:1.0:1787787256.929328:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0701646e00/0xdeb1953cba4b0fea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0fe3 expref: 19 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787256.929351:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694430848 00000100:00100000:1.0:1787787256.929354:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694430848 00010000:00010000:1.0:1787787256.929366:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0701647c00/0xdeb1953cba4b0fce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0fc7 expref: 20 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787256.929380:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787787256.929388:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e45a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1500c007-b35b-4004-b231-bb5a7ec082ef+20:3293:x1874630694430720:12345-0@lo:103: 00010000:00010000:1.0:1787787256.929401:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787256.929407:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0701646e00/0xdeb1953cba4b0fea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0fe3 expref: 20 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787256.929419:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0701646e00/0xdeb1953cba4b0fea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b0fe3 expref: 20 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787256.929474:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787256.929511:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e45a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1500c007-b35b-4004-b231-bb5a7ec082ef+20:3293:x1874630694430720:12345-0@lo:103: Request processed in 123us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787256.929518:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787787256.929535:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787787256.929542:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e46580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3293:x1874630694430848:12345-0@lo:103: 00010000:00010000:1.0:1787787256.929550:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787256.929555:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0701647c00/0xdeb1953cba4b0fce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0fc7 expref: 19 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787256.929563:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0701647c00/0xdeb1953cba4b0fce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b0fc7 expref: 19 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787256.929574:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787256.929596:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e46580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3293:x1874630694430848:12345-0@lo:103: Request processed in 55us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787256.929601:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787787256.929642:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073475f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694430848:0@lo:103: 00000100:00100000:1.0:1787787256.929650:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073475cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694430720:0@lo:103: 00010000:00010000:3.0:1787787256.929852:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787787256.929876:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d072212bc00/0xdeb1953cba4b0fff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b1006 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787256.929884:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d072212bc00/0xdeb1953cba4b0fff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b1006 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787256.929899:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787256.929902:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787256.929904:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787256.929911:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787787256.929921:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073473cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694430592:0@lo:103: 00000100:00100000:3.0:1787787256.931300:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787256.931412:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694429952:0@lo:103: 00000100:00100000:1.0:1787787256.932250:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694430592 00000100:00100000:1.0:1787787256.932261:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694430592 00010000:00010000:1.0:1787787256.932306:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b1006 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0fff expref: 19 pid: 5812 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787256.932341:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787787256.932351:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3292:x1874630694430592:12345-0@lo:103: 00010000:00010000:1.0:1787787256.932385:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787256.932392:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b1006 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0fff expref: 19 pid: 5812 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787256.932404:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b1006 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b0fff expref: 19 pid: 5812 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787256.932427:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787256.932625:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3292:x1874630694430592:12345-0@lo:103: Request processed in 275us (1332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787256.932634:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787787256.932682:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073473cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694430592:0@lo:103: 00000100:00100000:1.0:1787787256.933216:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787256.933297:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787256.933731:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678679552 00000100:00100000:0.0:1787787256.933741:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678679552 00010000:00010000:0.0:1787787256.933784:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0708771400/0xdeb1953cba4b1045 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34f44 expref: 10 pid: 5812 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787256.933810:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678679680 00000100:00100000:0.0:1787787256.933813:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678679680 00010000:00010000:0.0:1787787256.933825:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0708771200/0xdeb1953cba4b103e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34f3d expref: 11 pid: 5812 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787256.933838:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:0.0:1787787256.933845:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e46d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+11:2344:x1874630678679552:12345-192.168.206.10@tcp:103: 00010000:00010000:0.0:1787787256.933862:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787256.933868:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0708771400/0xdeb1953cba4b1045 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34f44 expref: 11 pid: 5812 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.933880:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0708771400/0xdeb1953cba4b1045 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34f44 expref: 11 pid: 5812 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.933916:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787256.933979:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e46d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+11:2344:x1874630678679552:12345-192.168.206.10@tcp:103: Request processed in 133us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787256.933997:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:0.0:1787787256.934015:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 17 00000100:00100000:0.0:1787787256.934021:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e461c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:2345:x1874630678679680:12345-192.168.206.10@tcp:103: 00010000:00010000:0.0:1787787256.934030:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787256.934034:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0708771200/0xdeb1953cba4b103e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34f3d expref: 10 pid: 5812 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.934044:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0708771200/0xdeb1953cba4b103e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34f3d expref: 10 pid: 5812 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.934053:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787256.934072:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e461c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:2345:x1874630678679680:12345-192.168.206.10@tcp:103: Request processed in 51us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787256.934078:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 17 00010000:00010000:2.0:1787787256.934568:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0700031800/0xdeb1953cba4b0fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b0f9d expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.934587:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0700031800/0xdeb1953cba4b0fa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b0f9d expref: 18 pid: 5813 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787256.934606:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874630694430976:0@lo:104: 00010000:00010000:3.0:1787787256.934612:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787256.934616:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787256.934619:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787256.934903:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787256.934954:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694430976 00000100:00100000:3.0:1787787256.934960:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694430976 00000100:00100000:3.0:1787787256.935019:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787787256.935028:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a08780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+3:8434:x1874630694430976:12345-0@lo:104: 00010000:00010000:3.0:1787787256.935046:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9d0700031c00/0xdeb1953cba4b0f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0fa4 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.935046:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d072212be00/0xdeb1953cba4b0f7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b0f73 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.935068:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d072212be00/0xdeb1953cba4b0f7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b0f73 expref: 18 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787256.935091:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a08b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874630694431104:0@lo:104: 00000100:00100000:2.0:1787787256.935141:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787787256.935154:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787787256.935159:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0707a78180 going to sleep for 11 seconds 00000100:00100000:3.0:1787787256.935162:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a08780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+3:8434:x1874630694430976:12345-0@lo:104: Request processed in 136us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787256.935171:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787787256.935186:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694431104 00010000:00010000:2.0:1787787256.935189:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0708771400/0xdeb1953cba4b1045 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34f44 expref: 9 pid: 5812 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787256.935191:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694431104 00000100:00100000:2.0:1787787256.935209:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b123c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874630694429568:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787787256.935212:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787787256.935223:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a09680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+3:8434:x1874630694431104:12345-0@lo:104: 00010000:00010000:2.0:1787787256.935230:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0708771200/0xdeb1953cba4b103e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34f3d expref: 8 pid: 5812 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787256.935232:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9d070141ee00/0xdeb1953cba4b0f73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0f7a expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787256.935263:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b120b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874630694429696:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787787256.935275:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787787256.935282:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a09680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+3:8434:x1874630694431104:12345-0@lo:104: Request processed in 61us (141us total) trans 0 rc 0/0 00010000:00010000:2.0:1787787256.935284:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0708771e00/0xdeb1953cba4b1030 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b1029 expref: 18 pid: 5812 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787256.935293:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787787256.935301:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b121e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874630694429824:0@lo:104: 00010000:00010000:3.0:1787787256.935313:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787787256.935318:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b1006 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b0fff expref: 17 pid: 5812 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787256.935321:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d0700031c00/0xdeb1953cba4b0f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0fa4 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787256.935336:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0700031c00 already unused, calling callback (ffffffffc1a9fc20) 00000100:00100000:2.0:1787787256.935336:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a09a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874630694430080:0@lo:104: 10000000:00010000:3.0:1787787256.935343:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d0700031c00/0xdeb1953cba4b0f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b0fa4 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.935353:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0701646e00/0xdeb1953cba4b0fea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b0fe3 expref: 16 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787256.935354:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d0700031c00/0xdeb1953cba4b0f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b0fa4 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787787256.935371:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d0700031c00/0xdeb1953cba4b0f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b0fa4 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787256.935374:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874630694430208:0@lo:104: 00000100:00100000:2.0:1787787256.935391:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0b840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874630694430336:0@lo:104: 10000000:01000000:3.0:1787787256.935401:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787787256.935407:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0701647c00/0xdeb1953cba4b0fce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b0fc7 expref: 15 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787256.935418:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874630694430464:0@lo:104: 00000100:00100000:2.0:1787787256.935427:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874630694430976:0@lo:104: 00000100:00100000:2.0:1787787256.935465:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a08b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1874630694431104:0@lo:104: 00010000:00010000:2.0:1787787256.935524:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d0701646000/0xdeb1953cba4b107d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.935565:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787256.935571:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d070141ee00/0xdeb1953cba4b0f73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0f7a expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.935591:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d070141ee00 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:2.0:1787787256.935594:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d070141ee00/0xdeb1953cba4b0f73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b0f7a expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.935602:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d070141ee00/0xdeb1953cba4b0f73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b0f7a expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787256.935609:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d070141ee00/0xdeb1953cba4b0f73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b0f7a expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787256.935614:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787787256.935646:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d0700031c00/0xdeb1953cba4b0f9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0fa4 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787256.935654:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787787256.935676:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d0700031c00/0xdeb1953cba4b0f9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0fa4 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787256.935684:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d0700031c00/0xdeb1953cba4b0f9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0fa4 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787256.935697:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787256.935699:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787256.935700:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787256.935716:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787787256.935729:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073473c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694431232:0@lo:103: 00010000:00010000:2.0:1787787256.935757:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d070141ee00/0xdeb1953cba4b0f73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0f7a expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.935766:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787787256.935778:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787787256.935785:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d070141ee00/0xdeb1953cba4b0f73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0f7a expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787256.935812:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694431232 00000100:00100000:3.0:1787787256.935816:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694431232 00010000:00010000:3.0:1787787256.935835:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0700031800/0xdeb1953cba4b0fa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0f9d expref: 15 pid: 5813 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787256.935851:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787787256.935857:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070873ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+15:3291:x1874630694431232:12345-0@lo:103: 00010000:00010000:3.0:1787787256.935867:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787256.935871:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0700031800/0xdeb1953cba4b0fa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0f9d expref: 15 pid: 5813 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787256.935881:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0700031800/0xdeb1953cba4b0fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b0f9d expref: 15 pid: 5813 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787256.935904:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0700031800/0xdeb1953cba4b0fa4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b0f9d expref: 15 pid: 5813 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787256.935916:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787787256.935921:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d070141ee00/0xdeb1953cba4b0f73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0f7a expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787256.935947:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070873ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+14:3291:x1874630694431232:12345-0@lo:103: Request processed in 89us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787256.935954:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1787787256.936000:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787256.936002:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787256.936004:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787256.936033:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073473c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694431232:0@lo:103: 00000100:00100000:1.0:1787787256.936307:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694431360:0@lo:103: 00000100:00100000:1.0:1787787256.936340:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787256.936417:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694431360 00000100:00100000:3.0:1787787256.936422:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694431360 00010000:00010000:3.0:1787787256.936586:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d072212be00/0xdeb1953cba4b0f7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0f73 expref: 14 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787256.936604:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787787256.936611:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e45a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+14:3293:x1874630694431360:12345-0@lo:103: 00010000:00010000:3.0:1787787256.936619:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787256.936624:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d072212be00/0xdeb1953cba4b0f7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0f73 expref: 14 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787256.936633:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d072212be00/0xdeb1953cba4b0f7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b0f73 expref: 14 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787256.936646:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d072212be00/0xdeb1953cba4b0f7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b0f73 expref: 14 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787256.936657:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787256.936686:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e45a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+13:3293:x1874630694431360:12345-0@lo:103: Request processed in 77us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787256.936693:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787787256.936777:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694431360:0@lo:103: 00010000:00010000:0.0:1787787256.937157:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d072212a000/0xdeb1953cba4b0fd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0fdc expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.937167:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212a000 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:0.0:1787787256.937172:0:8439:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d072212a000/0xdeb1953cba4b0fd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b0fdc expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.937182:0:8439:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d072212a000/0xdeb1953cba4b0fd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b0fdc expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787787256.937208:0:8439:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d072212a000/0xdeb1953cba4b0fd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b0fdc expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787256.937214:0:8439:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787787256.937280:0:8439:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d072212a000/0xdeb1953cba4b0fd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0fdc expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.937287:0:8439:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787787256.937338:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073475da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694431488:0@lo:103: 00000100:00100000:1.0:1787787256.937380:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787787256.937474:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d072212a000/0xdeb1953cba4b0fd5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0fdc expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.937483:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d072212a000/0xdeb1953cba4b0fd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0fdc expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787256.937514:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787256.937516:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787256.937519:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787256.937718:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694431488 00000100:00100000:2.0:1787787256.937726:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694431488 00010000:00010000:2.0:1787787256.937766:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d070141f600/0xdeb1953cba4b0fdc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0fd5 expref: 13 pid: 5812 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787256.937811:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787787256.937820:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e46580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1500c007-b35b-4004-b231-bb5a7ec082ef+13:3294:x1874630694431488:12345-0@lo:103: 00010000:00010000:2.0:1787787256.937834:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787256.937839:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d070141f600/0xdeb1953cba4b0fdc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0fd5 expref: 13 pid: 5812 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.937851:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d070141f600/0xdeb1953cba4b0fdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b0fd5 expref: 13 pid: 5812 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.937865:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d070141f600/0xdeb1953cba4b0fdc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b0fd5 expref: 13 pid: 5812 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.937881:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d0701646000/0xdeb1953cba4b107d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.937890:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0701646000/0xdeb1953cba4b107d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.937907:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d0701646000/0xdeb1953cba4b107d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.937914:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d0701646000/0xdeb1953cba4b107d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.937922:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d0701646000/0xdeb1953cba4b107d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.937939:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d0701646000/0xdeb1953cba4b107d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.937957:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0701646000 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:2.0:1787787256.937961:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d0701646000/0xdeb1953cba4b107d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.937970:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d0701646000/0xdeb1953cba4b107d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.937996:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d0701646000/0xdeb1953cba4b107d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787256.938007:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787787256.939692:0:8434:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d0701646000/0xdeb1953cba4b107d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787256.939732:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d0701646000/0xdeb1953cba4b107d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787256.939751:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0701646000/0xdeb1953cba4b107d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787256.944185:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e46580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1500c007-b35b-4004-b231-bb5a7ec082ef+12:3294:x1874630694431488:12345-0@lo:103: Request processed in 6354us (6792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787256.944206:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787787256.944234:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073475da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694431488:0@lo:103: 00000100:00100000:1.0:1787787257.212807:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694431872:0@lo:400: 00000100:00100000:1.0:1787787257.212900:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787257.212977:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787787257.212984:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1874630694432000:0@lo:400: 00000100:00100000:1.0:1787787257.213016:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787257.213076:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694431872 00000100:00100000:1.0:1787787257.213084:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694431872 00000100:00100000:1.0:1787787257.213187:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787787257.213197:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0708b583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694431872:12345-0@lo:400: 00000100:00100000:1.0:1787787257.213256:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0708b583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694431872:12345-0@lo:400: Request processed in 60us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787257.213264:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787787257.213288:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694432000 00000100:00100000:1.0:1787787257.213292:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694432000 00000100:00100000:1.0:1787787257.213322:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787787257.213328:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0708b5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874630694432000:12345-0@lo:400: 00000100:00100000:1.0:1787787257.213360:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0708b5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874630694432000:12345-0@lo:400: Request processed in 31us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787257.213366:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1787787257.213383:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787787257.213388:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787257.213428:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1874630694432000:0@lo:400: 00010000:00080000:1.0:1787787257.213475:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0737e44780 x1874630694431872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787257.213487:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694431872:0@lo:400: 00000100:00100000:3.0:1787787257.213590:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1874630694431744:0@lo:400: 00000100:00100000:3.0:1787787257.213627:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787257.213657:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787787257.213663:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874630694431616:0@lo:400: 00000100:00100000:3.0:1787787257.213685:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787257.213698:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0708b59680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694432128:0@lo:400: 00000100:00100000:3.0:1787787257.213718:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787257.214613:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694432128 00000100:00100000:2.0:1787787257.214623:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694432128 00000100:00100000:1.0:1787787257.214718:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694431744 00000100:00100000:1.0:1787787257.214723:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694431744 00000100:00100000:2.0:1787787257.214786:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787787257.214797:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694432128:12345-0@lo:400: 00000100:00100000:2.0:1787787257.214879:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694432128:12345-0@lo:400: Request processed in 84us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787257.214886:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1787787257.214947:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0708b59680 x1874630694432128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787257.214960:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0708b59680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694432128:0@lo:400: 00000100:00080000:3.0:1787787257.215460:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787787257.215466:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787787257.215908:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694431616 00000100:00100000:1.0:1787787257.215916:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694431616 00000100:00100000:2.0:1787787257.216288:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787787257.216302:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1874630694431744:12345-0@lo:400: 00000100:00100000:2.0:1787787257.216397:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1874630694431744:12345-0@lo:400: Request processed in 99us (2768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787257.216421:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787787257.216465:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787787257.216473:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1874630694431616:12345-0@lo:400: 00000100:00100000:2.0:1787787257.216524:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1874630694431616:12345-0@lo:400: Request processed in 52us (2838us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787257.216530:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787787257.216634:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874630694431616:0@lo:400: 00000100:00100000:3.0:1787787257.216650:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1874630694431744:0@lo:400: 00010000:00010000:3.0:1787787257.470500:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787257.724860:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0708b5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694432256:0@lo:13: 00000100:00100000:3.0:1787787257.724970:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787257.725149:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694432256 00000100:00100000:0.0:1787787257.725159:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694432256 00000100:00100000:0.0:1787787257.725220:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787787257.725231:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694432256:12345-0@lo:13: 00002000:00000024:0.0:1787787257.725285:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787787257.725356:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694432256:12345-0@lo:13: Request processed in 127us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787257.725364:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1787787257.725507:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0708b5a1c0 x1874630694432256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787257.725526:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0708b5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694432256:0@lo:13: 00010000:00010000:3.0:1787787258.492695:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787787258.556599:0:5817:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787787258.556632:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d070598a000 from 39 10000000:01000000:3.0:1787787258.556640:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787787258.556697:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0708770400/0xdeb1953cba4b1084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787258.556710:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d0708770400/0xdeb1953cba4b1084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787258.556724:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d0708770400/0xdeb1953cba4b1084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787258.556755:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073473d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694432384:0@lo:101: 00000100:00100000:3.0:1787787258.556848:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787258.556928:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0705129f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787787258.557247:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694432384 00000100:00100000:0.0:1787787258.557257:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694432384 00000100:00100000:0.0:1787787258.557341:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787787258.557360:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+12:5817:x1874630694432384:12345-0@lo:101: 00010000:00010000:0.0:1787787258.557377:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787258.557395:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0700030000/0xdeb1953cba4b108b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b1084 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787258.557424:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0700030000/0xdeb1953cba4b108b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b1084 expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787258.557462:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0700030000/0xdeb1953cba4b108b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b1084 expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787258.557472:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0700030000, rc 0) 00000100:00100000:3.0:1787787258.557701:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073473d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694432384:0@lo:101: 00010000:00010000:3.0:1787787258.557719:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d0708770400/0xdeb1953cba4b1084 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b108b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787258.557729:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d0708770400/0xdeb1953cba4b1084 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b108b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787258.557800:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073473d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694432512:0@lo:501: 00000100:00100000:3.0:1787787258.559815:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787258.560175:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0705129f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787787258.560307:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694432512 00000100:00100000:1.0:1787787258.560317:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694432512 00000100:00100000:1.0:1787787258.560385:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787787258.560401:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+14:5817:x1874630694432512:12345-0@lo:501: 00000100:00100000:1.0:1787787258.561360:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+14:5817:x1874630694432512:12345-0@lo:501: Request processed in 958us (1556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787258.561381:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787787258.561685:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+13:5817:x1874630694432384:12345-0@lo:101: Request processed in 4332us (4835us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787258.561694:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787787258.561734:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073473d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694432512:0@lo:501: 00000100:00100000:3.0:1787787258.561875:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073473d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694432640:0@lo:503: 00000100:00100000:3.0:1787787258.562062:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787258.562234:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694432640 00000100:00100000:2.0:1787787258.562241:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694432640 00000100:00100000:2.0:1787787258.562292:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787787258.562301:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+13:5817:x1874630694432640:12345-0@lo:503: 00000100:00100000:2.0:1787787258.562515:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+13:5817:x1874630694432640:12345-0@lo:503: Request processed in 216us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787258.562523:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787787258.563457:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0705129f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787787258.563504:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073473d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694432640:0@lo:503: 00000100:00100000:3.0:1787787258.564185:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073473d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8452:1874630694432768:0@lo:502: 00000100:00100000:3.0:1787787258.564262:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787258.564299:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0705129900 going to sleep for 11 seconds 00000100:00100000:0.0:1787787258.564402:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694432768 00000100:00100000:0.0:1787787258.564408:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694432768 00000100:00100000:0.0:1787787258.564476:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787787258.564485:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+13:8452:x1874630694432768:12345-0@lo:502: 00000100:00100000:0.0:1787787258.564780:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+13:8452:x1874630694432768:12345-0@lo:502: Request processed in 295us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787258.564788:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787787258.565173:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073473d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8452:1874630694432768:0@lo:502: 00000100:00100000:3.0:1787787258.565327:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073473d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8452:1874630694432896:0@lo:502: 00000100:00100000:3.0:1787787258.565373:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787258.565407:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0705129900 going to sleep for 11 seconds 00000100:00100000:1.0:1787787258.565473:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694432896 00000100:00100000:1.0:1787787258.565479:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694432896 00000100:00100000:1.0:1787787258.565519:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787787258.565528:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+13:8452:x1874630694432896:12345-0@lo:502: 00000100:00100000:1.0:1787787258.565751:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+13:8452:x1874630694432896:12345-0@lo:502: Request processed in 223us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787258.565758:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787787258.565966:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073473d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8452:1874630694432896:0@lo:502: 00000040:00080000:3.0:1787787258.565992:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787787258.566968:0:5817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787787258.567003:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787787258.567017:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0708770400/0xdeb1953cba4b1084 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b108b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787258.567031:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d0708770400/0xdeb1953cba4b1084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b108b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787258.567043:0:5817:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787787258.567046:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1787787258.567050:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787787258.567105:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d072212b200/0xdeb1953cba4b1092 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787258.567115:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d072212b200/0xdeb1953cba4b1092 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787258.567125:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d072212b200/0xdeb1953cba4b1092 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787258.567162:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0708b592c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694433024:0@lo:101: 00000100:00100000:1.0:1787787258.567248:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787258.567293:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0708ad89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787258.567425:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694433024 00000100:00100000:0.0:1787787258.567432:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694433024 00000100:00100000:0.0:1787787258.567521:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787787258.567542:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+13:5817:x1874630694433024:12345-0@lo:101: 00010000:00010000:0.0:1787787258.567556:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787258.567579:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0700030400/0xdeb1953cba4b1099 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b1092 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787258.567608:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0700030400/0xdeb1953cba4b1099 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b1092 expref: 14 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787258.567620:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0700030400/0xdeb1953cba4b1099 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b1092 expref: 14 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787258.567628:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0700030400, rc 0) 00000100:00100000:0.0:1787787258.567671:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+14:5817:x1874630694433024:12345-0@lo:101: Request processed in 141us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787258.567679:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787787258.568362:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0708b592c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694433024:0@lo:101: 00010000:00010000:1.0:1787787258.568387:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d072212b200/0xdeb1953cba4b1092 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b1099 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787258.568398:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d072212b200/0xdeb1953cba4b1092 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b1099 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787258.568502:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0708b592c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694433152:0@lo:501: 00000100:00100000:1.0:1787787258.568556:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787258.568584:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0708ad89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787258.568817:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694433152 00000100:00100000:0.0:1787787258.568824:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694433152 00000100:00100000:0.0:1787787258.568871:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787787258.568880:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+14:5817:x1874630694433152:12345-0@lo:501: 00000100:00100000:0.0:1787787258.569407:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+14:5817:x1874630694433152:12345-0@lo:501: Request processed in 526us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787258.569416:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787787258.569567:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0708b592c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694433152:0@lo:501: 00000100:00100000:2.0:1787787258.569612:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694433280:0@lo:503: 00000100:00100000:2.0:1787787258.569662:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787258.569692:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071046c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787258.569838:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694433280 00000100:00100000:3.0:1787787258.569845:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694433280 00000100:00100000:3.0:1787787258.569879:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787787258.569886:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+14:5817:x1874630694433280:12345-0@lo:503: 00000100:00100000:3.0:1787787258.570081:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+14:5817:x1874630694433280:12345-0@lo:503: Request processed in 195us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787258.570088:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787787258.570521:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694433280:0@lo:503: 00000100:00100000:1.0:1787787258.571050:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0708b5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8453:1874630694433408:0@lo:502: 00000100:00100000:1.0:1787787258.571127:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787258.571276:0:8453:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0708ad8300 going to sleep for 11 seconds 00000100:00100000:3.0:1787787258.571803:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694433408 00000100:00100000:3.0:1787787258.571812:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694433408 00000100:00100000:3.0:1787787258.571865:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787787258.571874:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+14:8453:x1874630694433408:12345-0@lo:502: 00000100:00100000:3.0:1787787258.572212:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+14:8453:x1874630694433408:12345-0@lo:502: Request processed in 337us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787258.572221:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787787258.572984:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0708b5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8453:1874630694433408:0@lo:502: 00000020:01000000:2.0:1787787258.573029:0:8453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787787258.573040:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787258.573042:0:8453:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787787258.573046:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787787258.573080:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8453:1874630694433536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787258.573215:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787258.573325:0:8453:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071046c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787258.573392:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694433536 00000100:00100000:0.0:1787787258.573400:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694433536 00000100:00100000:0.0:1787787258.573521:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787787258.573544:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+14:8453:x1874630694433536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787787258.573805:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+14:8453:x1874630694433536:12345-0@lo:502:llog_process_th.0 Request processed in 273us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787258.573812:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787787258.573944:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8453:1874630694433536:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787787258.573979:0:8453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787258.573985:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787258.573987:0:8453:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787787258.573992:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1787787258.574322:0:5817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1787787258.574342:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787787258.574354:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d072212b200/0xdeb1953cba4b1092 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b1099 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787258.574366:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d072212b200/0xdeb1953cba4b1092 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b1099 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787258.574378:0:5817:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787787258.574381:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d0707278800 from 39 10000000:01000000:2.0:1787787258.574385:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787787258.574420:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0701647c00/0xdeb1953cba4b10a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787258.574428:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d0701647c00/0xdeb1953cba4b10a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787258.574466:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d0701647c00/0xdeb1953cba4b10a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787258.574486:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694433664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787787258.574536:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787258.574568:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071046cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787787258.574893:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694433664 00000100:00100000:2.0:1787787258.574900:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694433664 00000100:00100000:2.0:1787787258.574944:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787787258.574953:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+14:5817:x1874630694433664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787258.574968:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787258.574985:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0701646e00/0xdeb1953cba4b10a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b10a0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787258.575024:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0701646e00/0xdeb1953cba4b10a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b10a0 expref: 15 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787258.575036:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0701646e00/0xdeb1953cba4b10a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b10a0 expref: 15 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787258.575047:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0701646e00, rc 0) 00000100:00100000:2.0:1787787258.575100:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+15:5817:x1874630694433664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787258.575108:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787787258.575162:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694433664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787258.575176:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d0701647c00/0xdeb1953cba4b10a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b10a7 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787258.575186:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d0701647c00/0xdeb1953cba4b10a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b10a7 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787258.575257:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694433792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787258.575284:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787258.575306:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071046cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787787258.575317:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694433792 00000100:00100000:2.0:1787787258.575320:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694433792 00000100:00100000:2.0:1787787258.575337:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787787258.575348:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+15:5817:x1874630694433792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787258.575875:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+15:5817:x1874630694433792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 524us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787258.575896:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787787258.576823:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694433792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787258.576901:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073475da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694433920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787787258.576970:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787258.577021:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071844be40 going to sleep for 11 seconds 00000100:00100000:1.0:1787787258.577103:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694433920 00000100:00100000:1.0:1787787258.577110:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694433920 00000100:00100000:1.0:1787787258.577173:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787787258.577182:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+15:5817:x1874630694433920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787258.577421:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+15:5817:x1874630694433920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 240us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787258.577430:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787787258.577735:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073475da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694433920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787787258.578220:0:8454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073475da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8454:1874630694434048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787787258.578288:0:8454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787258.578327:0:8454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071844b240 going to sleep for 11 seconds 00000100:00100000:1.0:1787787258.578907:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694434048 00000100:00100000:1.0:1787787258.578916:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694434048 00000100:00100000:1.0:1787787258.578976:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787787258.578988:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+15:8454:x1874630694434048:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787258.579481:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+15:8454:x1874630694434048:12345-0@lo:502:llog_process_th.0 Request processed in 494us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787258.579496:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787787258.585844:0:8454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073475da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8454:1874630694434048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787258.585968:0:8454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8454:1874630694434176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787258.586067:0:8454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787258.586212:0:8454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071046cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787787258.586383:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694434176 00000100:00100000:0.0:1787787258.586391:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694434176 00000100:00100000:0.0:1787787258.586548:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787787258.586560:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+15:8454:x1874630694434176:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787787258.586886:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+15:8454:x1874630694434176:12345-0@lo:502:llog_process_th.0 Request processed in 327us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787258.586895:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787787258.586983:0:8454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8454:1874630694434176:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787787258.587013:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787787258.587101:0:5817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787787258.587127:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787787258.587150:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0701647c00/0xdeb1953cba4b10a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b10a7 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787258.587163:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d0701647c00/0xdeb1953cba4b10a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b10a7 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787258.587174:0:5817:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787787258.587178:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1787787258.587181:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787787258.587211:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0701646800/0xdeb1953cba4b10ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787258.587219:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d0701646800/0xdeb1953cba4b10ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787258.588115:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d0701646800/0xdeb1953cba4b10ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787258.588158:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694434304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787787258.588236:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787258.588855:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071046c480 going to sleep for 11 seconds 00000100:00100000:1.0:1787787258.590864:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694434304 00000100:00100000:1.0:1787787258.590884:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694434304 00000100:00100000:1.0:1787787258.590966:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787787258.590977:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+15:5817:x1874630694434304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787258.590998:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787258.591023:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d072212a000/0xdeb1953cba4b10b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b10ae expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787258.591059:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d072212a000/0xdeb1953cba4b10b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b10ae expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787258.591072:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d072212a000/0xdeb1953cba4b10b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b10ae expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787258.591083:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d072212a000, rc 0) 00000100:00100000:1.0:1787787258.591424:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+16:5817:x1874630694434304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 446us (3196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787258.591432:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787787258.592889:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694434304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787258.592924:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d0701646800/0xdeb1953cba4b10ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b10b5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787258.592938:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d0701646800/0xdeb1953cba4b10ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b10b5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787258.593044:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694434432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787258.593118:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787258.593175:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071046c480 going to sleep for 11 seconds 00000100:00100000:1.0:1787787258.593362:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694434432 00000100:00100000:1.0:1787787258.593370:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694434432 00000100:00100000:1.0:1787787258.593424:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787787258.593434:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+16:5817:x1874630694434432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787258.593915:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+16:5817:x1874630694434432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 480us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787258.593925:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787787258.595407:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694434432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787258.595603:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694434560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787258.595697:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787258.595737:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071046c480 going to sleep for 11 seconds 00000100:00100000:0.0:1787787258.595833:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694434560 00000100:00100000:0.0:1787787258.595841:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694434560 00000100:00100000:0.0:1787787258.595895:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787787258.595906:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+16:5817:x1874630694434560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787787258.596520:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+16:5817:x1874630694434560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 612us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787258.596529:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787787258.601520:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694434560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787258.603567:0:8455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8455:1874630694434688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787258.603673:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787258.603725:0:8455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071046cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787787258.603931:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694434688 00000100:00100000:3.0:1787787258.603941:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694434688 00000100:00100000:3.0:1787787258.603997:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787787258.604007:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+16:8455:x1874630694434688:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787787258.604330:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+16:8455:x1874630694434688:12345-0@lo:502:llog_process_th.0 Request processed in 322us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787258.604339:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787787258.604607:0:8455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8455:1874630694434688:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787787258.604646:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787787258.604658:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787258.604661:0:8455:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787787258.604667:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787787258.604703:0:8455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8455:1874630694434816:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787258.604762:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787258.604804:0:8455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071046cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787787258.605144:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694434816 00000100:00100000:1.0:1787787258.605159:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694434816 00000100:00100000:1.0:1787787258.605209:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787787258.605218:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+16:8455:x1874630694434816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787258.605658:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+16:8455:x1874630694434816:12345-0@lo:502:llog_process_th.0 Request processed in 439us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787258.605666:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787787258.605904:0:8455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8455:1874630694434816:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787787258.605935:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787787258.605946:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787258.605949:0:8455:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787787258.605953:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1787787258.606660:0:5817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1787787258.606688:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787787258.606703:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0701646800/0xdeb1953cba4b10ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b10b5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787258.606717:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d0701646800/0xdeb1953cba4b10ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b10b5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787258.606752:0:5817:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787787258.606755:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d0722109800 from 39 10000000:01000000:3.0:1787787258.606759:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787787258.606797:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0708770c00/0xdeb1953cba4b10bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787258.606805:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d0708770c00/0xdeb1953cba4b10bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787258.606829:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d0708770c00/0xdeb1953cba4b10bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787258.606854:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073473d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694434944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787787258.606916:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787258.606966:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0705129e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787787258.607056:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694434944 00000100:00100000:0.0:1787787258.607063:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694434944 00000100:00100000:0.0:1787787258.607127:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787787258.607138:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703094050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+16:5817:x1874630694434944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787258.607162:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787258.607180:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0700031800/0xdeb1953cba4b10c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b10bc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787258.607214:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0700031800/0xdeb1953cba4b10c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b10bc expref: 17 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787258.607227:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0700031800/0xdeb1953cba4b10c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b10bc expref: 17 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787258.607237:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0700031800, rc 0) 00000100:00100000:0.0:1787787258.607291:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703094050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+17:5817:x1874630694434944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787258.607298:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787787258.607893:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073473d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694434944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787258.607917:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d0708770c00/0xdeb1953cba4b10bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b10c3 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787258.607927:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d0708770c00/0xdeb1953cba4b10bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b10c3 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787258.608001:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694435072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787258.608128:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787258.608166:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071046cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787787258.608228:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694435072 00000100:00100000:1.0:1787787258.608234:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694435072 00000100:00100000:1.0:1787787258.608277:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787787258.608286:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+17:5817:x1874630694435072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787258.608770:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+17:5817:x1874630694435072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 484us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787258.608780:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787787258.608886:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694435072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787258.608922:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694435200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787258.608963:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787258.609033:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071046cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787787258.609307:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694435200 00000100:00100000:3.0:1787787258.609314:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694435200 00000100:00100000:3.0:1787787258.609399:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787787258.609408:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+17:5817:x1874630694435200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787787258.609641:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+17:5817:x1874630694435200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 234us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787258.609649:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787787258.609987:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694435200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787258.611921:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8456:1874630694435328:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787258.612115:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787258.612217:0:8456:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071046cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787787258.614996:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694435328 00000100:00100000:3.0:1787787258.615096:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694435328 00000100:00100000:3.0:1787787258.615177:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787787258.615189:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+17:8456:x1874630694435328:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787787258.615603:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+17:8456:x1874630694435328:12345-0@lo:502:llog_process_th.0 Request processed in 413us (3485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787258.615612:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787787258.615778:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8456:1874630694435328:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787258.615857:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8456:1874630694435456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787258.615904:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787258.615940:0:8456:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071046cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787787258.616192:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694435456 00000100:00100000:3.0:1787787258.616199:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694435456 00000100:00100000:3.0:1787787258.616229:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787787258.616236:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+17:8456:x1874630694435456:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787787258.616518:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+17:8456:x1874630694435456:12345-0@lo:502:llog_process_th.0 Request processed in 281us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787258.616533:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787787258.616727:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8456:1874630694435456:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787787258.616754:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787787258.616974:0:5817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787787258.616995:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787787258.617007:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0708770c00/0xdeb1953cba4b10bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b10c3 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787258.617108:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d0708770c00/0xdeb1953cba4b10bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b10c3 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787258.617119:0:5817:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787787258.617122:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1787787258.617125:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787787258.617160:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d072212be00/0xdeb1953cba4b10ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787258.617168:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d072212be00/0xdeb1953cba4b10ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787258.617187:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d072212be00/0xdeb1953cba4b10ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787258.617209:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0708b58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694435584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787787258.617256:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787258.617331:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07094a19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787258.617380:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694435584 00000100:00100000:3.0:1787787258.617387:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694435584 00000100:00100000:3.0:1787787258.617586:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787787258.617596:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+17:5817:x1874630694435584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787787258.617609:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787258.617624:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0708770a00/0xdeb1953cba4b10d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b10ca expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787258.617652:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0708770a00/0xdeb1953cba4b10d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b10ca expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787258.617663:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0708770a00/0xdeb1953cba4b10d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b10ca expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787258.617673:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708770a00, rc 0) 00000100:00100000:3.0:1787787258.617762:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+18:5817:x1874630694435584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787258.617770:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787787258.617859:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0708b58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694435584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787258.617874:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d072212be00/0xdeb1953cba4b10ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b10d1 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787258.617883:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d072212be00/0xdeb1953cba4b10ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b10d1 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787258.617943:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0708b58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694435712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787258.617968:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787258.618038:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07094a19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787258.618143:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694435712 00000100:00100000:3.0:1787787258.618148:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694435712 00000100:00100000:3.0:1787787258.618211:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787787258.618219:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+18:5817:x1874630694435712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787258.618539:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+18:5817:x1874630694435712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 320us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787258.618547:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787787258.618620:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0708b58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694435712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787258.618654:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0708b58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694435840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787258.618697:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787258.618834:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07094a19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787258.618872:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694435840 00000100:00100000:2.0:1787787258.618878:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694435840 00000100:00100000:2.0:1787787258.618903:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787787258.618909:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703097050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+18:5817:x1874630694435840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787258.619193:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703097050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+18:5817:x1874630694435840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 283us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787258.619200:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787787258.619275:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0708b58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694435840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787258.620731:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0708b58000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8457:1874630694435968:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787258.620817:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787258.620854:0:8457:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07094a1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787787258.620939:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694435968 00000100:00100000:0.0:1787787258.620946:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694435968 00000100:00100000:0.0:1787787258.620996:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787787258.621006:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+18:8457:x1874630694435968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787787258.621315:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+18:8457:x1874630694435968:12345-0@lo:502:llog_process_th.0 Request processed in 308us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787258.621324:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787787258.621524:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0708b58000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8457:1874630694435968:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787787258.621557:0:8457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787787258.621568:0:8457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787258.621572:0:8457:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787787258.621578:0:8457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787787258.621605:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0708b58000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8457:1874630694436096:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787258.621645:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787258.621677:0:8457:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070595c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787258.621736:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694436096 00000100:00100000:3.0:1787787258.621749:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694436096 00000100:00100000:3.0:1787787258.621802:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787787258.621810:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+18:8457:x1874630694436096:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787787258.622111:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+18:8457:x1874630694436096:12345-0@lo:502:llog_process_th.0 Request processed in 300us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787258.622121:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787787258.628614:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0708b58000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8457:1874630694436096:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787787258.628680:0:8457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787787258.628694:0:8457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787258.628697:0:8457:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787787258.628703:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1787787258.628927:0:5817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1787787258.628950:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787787258.628963:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d072212be00/0xdeb1953cba4b10ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b10d1 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787258.628976:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d072212be00/0xdeb1953cba4b10ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b10d1 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787258.628989:0:5817:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787787258.628992:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9d0703128000 from 1 10000000:01000000:2.0:1787787258.628996:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787787258.629189:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0701646000/0xdeb1953cba4b10d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787258.629199:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d0701646000/0xdeb1953cba4b10d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787258.629228:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d0701646000/0xdeb1953cba4b10d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787258.629253:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694436224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787787258.629334:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787258.629387:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071046c480 going to sleep for 11 seconds 00000100:00100000:3.0:1787787258.629551:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694436224 00000100:00100000:3.0:1787787258.629559:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694436224 00000100:00100000:3.0:1787787258.629667:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787787258.629679:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+18:5817:x1874630694436224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787787258.629695:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787258.629712:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0708771a00/0xdeb1953cba4b10df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b10d8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787258.629741:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0708771a00/0xdeb1953cba4b10df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b10d8 expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787258.629753:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0708771a00/0xdeb1953cba4b10df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b10d8 expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787258.629764:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708771a00, rc 0) 00000100:00100000:3.0:1787787258.629820:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:5817:x1874630694436224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787258.629828:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787787258.629896:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694436224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787258.629912:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d0701646000/0xdeb1953cba4b10d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b10df expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787258.629921:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d0701646000/0xdeb1953cba4b10d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b10df expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787258.629978:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694436352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787258.630004:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787258.630264:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071046c480 going to sleep for 11 seconds 00000100:00100000:0.0:1787787258.630604:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694436352 00000100:00100000:0.0:1787787258.630610:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694436352 00000100:00100000:0.0:1787787258.630645:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787787258.630654:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:5817:x1874630694436352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787258.630956:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:5817:x1874630694436352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 303us (950us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787787258.630976:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787787258.631171:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694436352:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1787787258.631206:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787787258.631216:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0701646000/0xdeb1953cba4b10d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b10df expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787258.631227:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d0701646000/0xdeb1953cba4b10d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b10df expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787258.748815:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787787258.748848:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073475fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694436480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787258.748963:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787258.750698:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694436480 00000100:00100000:0.0:1787787258.750717:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694436480 00000100:00100000:0.0:1787787258.750858:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787787258.750873:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694436480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787787258.750931:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787787258.751037:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694436480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 168us (2074us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787258.751046:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1787787258.751159:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d073475fc00 x1874630694436480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787258.751183:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073475fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694436480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787787258.850685:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787258.850796:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787258.850837:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787258.850863:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787258.850903:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678680064 00000100:00100000:3.0:1787787258.850911:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678680064 00000100:00100000:3.0:1787787258.850967:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678680192 00000100:00100000:3.0:1787787258.850971:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678680192 00000100:00100000:3.0:1787787258.850989:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:3.0:1787787258.851003:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2342:x1874630678680064:12345-192.168.206.10@tcp:400: 00000100:00100000:3.0:1787787258.851066:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2342:x1874630678680064:12345-192.168.206.10@tcp:400: Request processed in 66us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787258.851074:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:3.0:1787787258.851100:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:3.0:1787787258.851107:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2342:x1874630678680192:12345-192.168.206.10@tcp:400: 00000100:00100000:3.0:1787787258.851128:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2342:x1874630678680192:12345-192.168.206.10@tcp:400: Request processed in 22us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787258.851134:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00080000:3.0:1787787258.851148:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787787258.851151:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787787258.854958:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678679808 00000100:00100000:0.0:1787787258.854970:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678679808 00000100:00100000:0.0:1787787258.855026:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 162 00000100:00100000:0.0:1787787258.855035:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+8:2342:x1874630678679808:12345-192.168.206.10@tcp:400: 00000100:00100000:0.0:1787787258.855184:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+8:2342:x1874630678679808:12345-192.168.206.10@tcp:400: Request processed in 148us (4506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787258.855193:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 162 00000100:00100000:2.0:1787787258.855553:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678679936 00000100:00100000:2.0:1787787258.855567:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678679936 00000100:00080000:0.0:1787787258.855663:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787258.855670:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 28 00000100:00100000:2.0:1787787258.855680:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2342:x1874630678679936:12345-192.168.206.10@tcp:400: 00000100:00100000:2.0:1787787258.855763:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2342:x1874630678679936:12345-192.168.206.10@tcp:400: Request processed in 84us (4925us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787258.855770:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 28 00010000:00010000:2.0:1787787259.517152:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787260.540904:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787261.564720:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787261.925433:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787261.925613:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678680320 00000100:00100000:3.0:1787787261.925623:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678680320 00000100:00100000:3.0:1787787261.925679:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 163 00000100:00100000:3.0:1787787261.925688:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+8:5584:x1874630678680320:12345-192.168.206.10@tcp:101: 00010000:00010000:3.0:1787787261.925705:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787261.925721:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0708771000/0xdeb1953cba4b10e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c34fa6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787261.925750:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0708771000/0xdeb1953cba4b10e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34fa6 expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787261.925781:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0708771000/0xdeb1953cba4b10e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34fa6 expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787261.925791:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708771000, rc 0) 00000100:00100000:3.0:1787787261.925861:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+9:5584:x1874630678680320:12345-192.168.206.10@tcp:101: Request processed in 173us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787261.925868:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 163 00000100:00100000:3.0:1787787261.930630:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787261.930833:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678680448 00000100:00100000:0.0:1787787261.930841:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678680448 00000100:00100000:0.0:1787787261.930900:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 164 00000100:00100000:0.0:1787787261.930909:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+9:5584:x1874630678680448:12345-192.168.206.10@tcp:501: 00000100:00100000:0.0:1787787261.931552:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+9:5584:x1874630678680448:12345-192.168.206.10@tcp:501: Request processed in 641us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787261.931562:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 164 00000100:00100000:1.0:1787787261.937551:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787261.942245:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678680576 00000100:00100000:0.0:1787787261.942278:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678680576 00000100:00100000:0.0:1787787261.942410:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 165 00000100:00100000:0.0:1787787261.942421:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+9:5584:x1874630678680576:12345-192.168.206.10@tcp:503: 00000100:00100000:0.0:1787787261.942675:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+9:5584:x1874630678680576:12345-192.168.206.10@tcp:503: Request processed in 256us (5130us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787261.942683:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 165 00000100:00100000:1.0:1787787261.949426:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787261.950002:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678680704 00000100:00100000:3.0:1787787261.950012:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678680704 00000100:00100000:3.0:1787787261.950083:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 166 00000100:00100000:3.0:1787787261.950101:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+9:6074:x1874630678680704:12345-192.168.206.10@tcp:502: 00000100:00100000:3.0:1787787261.950359:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+9:6074:x1874630678680704:12345-192.168.206.10@tcp:502: Request processed in 267us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787261.950368:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 166 00000100:00100000:3.0:1787787261.952975:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787261.953368:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678680832 00000100:00100000:1.0:1787787261.953377:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678680832 00000100:00100000:1.0:1787787261.953431:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 167 00000100:00100000:1.0:1787787261.953487:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703093050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+9:6074:x1874630678680832:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787787261.953754:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703093050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+9:6074:x1874630678680832:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 313us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787261.953762:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 167 00000100:00100000:2.0:1787787261.965850:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787261.966605:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678680960 00000100:00100000:1.0:1787787261.966616:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678680960 00000100:00100000:1.0:1787787261.966675:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 168 00000100:00100000:1.0:1787787261.966685:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+9:5584:x1874630678680960:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787261.966713:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787261.966741:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d072212b400/0xdeb1953cba4b10ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c34fad expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787261.966768:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d072212b400/0xdeb1953cba4b10ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34fad expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787261.966778:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d072212b400/0xdeb1953cba4b10ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34fad expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787261.966787:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d072212b400, rc 0) 00000100:00100000:1.0:1787787261.966854:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:5584:x1874630678680960:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 Request processed in 170us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787261.966861:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 168 00000100:00100000:2.0:1787787261.969424:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787261.969571:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678681088 00000100:00100000:3.0:1787787261.969580:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678681088 00000100:00100000:3.0:1787787261.969632:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 169 00000100:00100000:3.0:1787787261.969643:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:5584:x1874630678681088:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787261.969886:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:5584:x1874630678681088:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 Request processed in 245us (470us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787787261.969894:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 169 00000100:00100000:3.0:1787787262.332813:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1874630694436736:0@lo:400:kworker.0 00000100:00100000:3.0:1787787262.332894:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787262.332968:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694437248:0@lo:400:kworker.0 00000100:00100000:3.0:1787787262.332994:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787262.333025:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787787262.333031:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694436864:0@lo:400:kworker.0 00000100:00100000:3.0:1787787262.333052:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787262.333102:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694437248 00000100:00100000:3.0:1787787262.333109:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694437248 00000100:00100000:2.0:1787787262.333228:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694436736 00000100:00100000:2.0:1787787262.333232:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694436736 00000100:00100000:2.0:1787787262.333256:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694436864 00000100:00100000:2.0:1787787262.333259:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694436864 00000100:00100000:2.0:1787787262.333275:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787787262.333282:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1874630694436736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787262.333336:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1874630694436736:12345-0@lo:400:kworker.0 Request processed in 53us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787262.333343:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787787262.333358:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787787262.333364:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694436864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787262.333391:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694436864:12345-0@lo:400:kworker.0 Request processed in 28us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787262.333404:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787787262.333481:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694436864:0@lo:400:kworker.0 00000100:00100000:2.0:1787787262.333491:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1874630694436736:0@lo:400:kworker.0 00000100:00100000:3.0:1787787262.333570:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787787262.333580:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694437248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787262.333619:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694437248:12345-0@lo:400:kworker.0 Request processed in 42us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787262.333625:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1787787262.333651:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0707a0b480 x1874630694437248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787262.333661:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694437248:0@lo:400:kworker.0 00000100:00100000:0.0:1787787262.333814:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694436608:0@lo:400:kworker.0 00000100:00100000:0.0:1787787262.333848:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787262.333878:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1874630694437120:0@lo:400:kworker.0 00000100:00100000:0.0:1787787262.333900:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787262.333919:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787787262.333925:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694436992:0@lo:400:kworker.0 00000100:00100000:0.0:1787787262.333947:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787787262.333967:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787787262.333971:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787787262.333978:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694437120 00000100:00100000:0.0:1787787262.333982:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694437120 00000100:00100000:0.0:1787787262.334009:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787787262.334014:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073475f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874630694437120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787262.334046:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073475f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874630694437120:12345-0@lo:400:kworker.0 Request processed in 31us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787262.334052:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1787787262.334065:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787262.334094:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1874630694437120:0@lo:400:kworker.0 00000100:00100000:2.0:1787787262.334141:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694436992 00000100:00100000:2.0:1787787262.334145:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694436992 00000100:00100000:2.0:1787787262.334233:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787787262.334241:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073475e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694436992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787262.334276:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073475e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694436992:12345-0@lo:400:kworker.0 Request processed in 36us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787262.334282:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787787262.334341:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694436608 00000100:00100000:3.0:1787787262.334345:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694436608 00000100:00100000:3.0:1787787262.334375:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787787262.334381:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3294:x1874630694436608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787262.334413:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3294:x1874630694436608:12345-0@lo:400:kworker.0 Request processed in 32us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787262.334419:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:0.0:1787787262.334493:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787787262.334512:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0707a0a1c0 x1874630694436992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787262.334532:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694436992:0@lo:400:kworker.0 00000100:00100000:0.0:1787787262.334542:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694436608:0@lo:400:kworker.0 00010000:00010000:3.0:1787787262.588856:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787262.845931:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787787262.845956:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0708b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694437376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787787262.846031:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787262.846111:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694437376 00000100:00100000:1.0:1787787262.846119:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694437376 00000100:00100000:1.0:1787787262.846171:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787787262.846180:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0708b59e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694437376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787787262.846212:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787787262.846258:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0708b59e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694437376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787262.846265:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1787787262.846486:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0708b58000 x1874630694437376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787262.846535:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0708b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694437376:0@lo:13:osp-pre-1-0.0 00000020:00000080:0.0:1787787263.199024:0:8494:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffefd1a61d0 20000000:00000080:0.0:1787787263.199049:0:8494:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d07378ccc00 uarg=0000000000000000 20000000:01000000:0.0:1787787263.199106:0:8494:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787787263.199113:0:8494:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787787263.199119:0:8494:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787787263.200166:0:8495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1787787263.200360:0:8494:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1787787263.204850:0:8494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1787787263.204921:0:8494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1787787263.204982:0:8494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1787787263.205003:0:8494:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787787263.205027:0:8494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b10f4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787263.205050:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d072212a800/0xdeb1953cba4b0ebd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0eb6 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787263.205059:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d072212ba00/0xdeb1953cba4b0f34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0f2d expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787263.205080:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d070141e800/0xdeb1953cba4b0f96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b0f8f expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787263.205090:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0700030800/0xdeb1953cba4b1053 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34f75 expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787263.205099:0:8494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b10f4 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787263.205162:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0700030800/0xdeb1953cba4b1053 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34f75 expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787263.205182:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d0700030800/0xdeb1953cba4b1053 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34f75 expref: 9 pid: 5813 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787263.205200:0:8494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073475c780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1874630694437504:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787787263.205338:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d070141e800/0xdeb1953cba4b0f96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b0f8f expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787263.205348:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d070141e800/0xdeb1953cba4b0f96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b0f8f expref: 18 pid: 5814 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787263.205358:0:8494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073475cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1874630694437632:0@lo:104: 00000100:00100000:0.0:1787787263.205410:0:8494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787787263.205505:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d072212ba00/0xdeb1953cba4b0f34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b0f2d expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787263.205514:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d072212ba00/0xdeb1953cba4b0f34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b0f2d expref: 18 pid: 5814 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787263.206488:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694437632 00000100:00100000:2.0:1787787263.206501:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694437632 00000100:00100000:2.0:1787787263.206572:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787787263.206585:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073475d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+3:8494:x1874630694437632:12345-0@lo:104: 00010000:00010000:2.0:1787787263.206603:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9d0700030200/0xdeb1953cba4b0f8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0f96 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787263.206681:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787787263.206687:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073475d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+3:8494:x1874630694437632:12345-0@lo:104: Request processed in 106us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787263.206695:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1787787263.206733:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787263.206741:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d0700030200/0xdeb1953cba4b0f8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0f96 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787263.206749:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0700030200 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:2.0:1787787263.206770:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d0700030200/0xdeb1953cba4b0f8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b0f96 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787263.206781:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d0700030200/0xdeb1953cba4b0f8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b0f96 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787263.206789:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d0700030200/0xdeb1953cba4b0f8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b0f96 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787263.206796:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787787263.206834:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d0700030200/0xdeb1953cba4b0f8f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0f96 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787263.206840:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787263.206866:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d0700030200/0xdeb1953cba4b0f8f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0f96 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787263.206873:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d0700030200/0xdeb1953cba4b0f8f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0f96 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787263.206888:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787263.206890:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787263.206892:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787263.206909:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787787263.206925:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694437888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787263.206965:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787263.208741:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694437888 00000100:00100000:1.0:1787787263.208759:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694437888 00010000:00010000:1.0:1787787263.209489:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d070141e800/0xdeb1953cba4b0f96 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0f8f expref: 19 pid: 5814 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787263.209548:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787787263.209687:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3294:x1874630694437888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787787263.209710:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787263.210083:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d070141e800/0xdeb1953cba4b0f96 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0f8f expref: 19 pid: 5814 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787263.210176:0:8494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073475c3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1874630694437760:0@lo:104: 00000100:00100000:0.0:1787787263.210268:0:8494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787787263.210348:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d070141e800/0xdeb1953cba4b0f96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b0f8f expref: 19 pid: 5814 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787263.210377:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787263.210431:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3294:x1874630694437888:12345-0@lo:103:ldlm_bl.0 Request processed in 754us (3465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787263.210876:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787263.211169:0:5807:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787787263.211181:0:5807:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1787787263.211375:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787787263.211393:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694437760 00000100:00100000:2.0:1787787263.211407:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694437760 00000100:00100000:2.0:1787787263.211486:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787787263.211496:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073767fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+3:8494:x1874630694437760:12345-0@lo:104: 00010000:00010000:2.0:1787787263.211515:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9d072212ac00/0xdeb1953cba4b0f2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0f34 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787263.211574:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787787263.211581:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073767fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+3:8494:x1874630694437760:12345-0@lo:104: Request processed in 88us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787263.211588:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1787787263.211637:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787263.211644:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d072212ac00/0xdeb1953cba4b0f2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0f34 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787263.211652:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212ac00 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:2.0:1787787263.211657:0:8439:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d072212ac00/0xdeb1953cba4b0f2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b0f34 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787263.211665:0:8439:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d072212ac00/0xdeb1953cba4b0f2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b0f34 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787263.211673:0:8439:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d072212ac00/0xdeb1953cba4b0f2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b0f34 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787263.211679:0:8439:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787787263.211716:0:8439:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d072212ac00/0xdeb1953cba4b0f2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0f34 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787263.211723:0:8439:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787263.211743:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d072212ac00/0xdeb1953cba4b0f2d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0f34 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787263.211756:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d072212ac00/0xdeb1953cba4b0f2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0f34 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787263.211771:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787263.211773:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787263.211775:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787263.211807:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678681216 00000100:00100000:2.0:1787787263.211812:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678681216 00010000:00010000:2.0:1787787263.211831:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0700030800/0xdeb1953cba4b1053 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34f75 expref: 10 pid: 5813 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787263.215191:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d072212a800/0xdeb1953cba4b0ebd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b0eb6 expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787263.215216:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d072212a800/0xdeb1953cba4b0ebd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b0eb6 expref: 19 pid: 5812 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787263.215258:0:8494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073475d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1874630694438144:0@lo:104: 00000100:00100000:0.0:1787787263.215340:0:8494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787263.215400:0:8494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071844b240 going to sleep for 11 seconds 00000100:00100000:0.0:1787787263.215432:0:8494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073475c780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1874630694437504:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787787263.215887:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694438144 00000100:00100000:3.0:1787787263.215896:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694438144 00000100:00100000:3.0:1787787263.215945:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787787263.215954:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073475fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+3:8494:x1874630694438144:12345-0@lo:104: 00010000:00010000:3.0:1787787263.215970:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9d070141fe00/0xdeb1953cba4b0eb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0ebd expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787263.216030:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787787263.216036:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073475fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+3:8494:x1874630694438144:12345-0@lo:104: Request processed in 83us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787263.216043:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1787787263.216076:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787263.216083:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d070141fe00/0xdeb1953cba4b0eb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b0ebd expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787263.216091:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d070141fe00 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:3.0:1787787263.216096:0:8440:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d070141fe00/0xdeb1953cba4b0eb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b0ebd expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787263.216106:0:8440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d070141fe00/0xdeb1953cba4b0eb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b0ebd expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787787263.216114:0:8440:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d070141fe00/0xdeb1953cba4b0eb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b0ebd expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787263.216121:0:8440:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787787263.216166:0:8440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d070141fe00/0xdeb1953cba4b0eb6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0ebd expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787263.216174:0:8440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787787263.216194:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d070141fe00/0xdeb1953cba4b0eb6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0ebd expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787263.216202:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d070141fe00/0xdeb1953cba4b0eb6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b0ebd expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787263.216224:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787263.216226:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787263.216228:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787263.216240:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073473da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694438272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787787263.216271:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787263.216315:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694438272 00000100:00100000:3.0:1787787263.216318:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694438272 00010000:00010000:3.0:1787787263.216335:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d072212a800/0xdeb1953cba4b0ebd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0eb6 expref: 20 pid: 5812 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787263.216354:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787787263.216360:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+20:3291:x1874630694438272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787787263.216370:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787263.216375:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d072212a800/0xdeb1953cba4b0ebd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0eb6 expref: 20 pid: 5812 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787263.216385:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d072212a800/0xdeb1953cba4b0ebd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b0eb6 expref: 20 pid: 5812 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787263.216404:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787263.216433:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+20:3291:x1874630694438272:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787263.216469:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787787263.216494:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073473da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694438272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787787263.217159:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787787263.217199:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1787787263.217283:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d070141e800/0xdeb1953cba4b0f96 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b0f8f expref: 18 pid: 5814 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787263.217300:0:8494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073475cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1874630694437632:0@lo:104: 00000100:00100000:0.0:1787787263.217309:0:8494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073475c3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1874630694437760:0@lo:104: 00010000:00010000:0.0:1787787263.217317:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d072212a800/0xdeb1953cba4b0ebd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b0eb6 expref: 17 pid: 5812 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787263.217326:0:8494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073475d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1874630694438144:0@lo:104: 00000100:00100000:1.0:1787787263.217337:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694438016:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787787263.217362:0:8494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b10f4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787263.217394:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787263.217477:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694437888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787263.219923:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694438016 00000100:00100000:2.0:1787787263.219941:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694438016 00010000:00010000:2.0:1787787263.220078:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d072212ba00/0xdeb1953cba4b0f34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0f2d expref: 17 pid: 5814 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787263.220119:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 23 00000100:00100000:2.0:1787787263.220130:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a09e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:2344:x1874630678681216:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787263.220151:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787263.220166:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0700030800/0xdeb1953cba4b1053 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34f75 expref: 10 pid: 5813 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787263.220183:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0700030800/0xdeb1953cba4b1053 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34f75 expref: 10 pid: 5813 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787263.220204:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0700030800/0xdeb1953cba4b1053 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34f75 expref: 10 pid: 5813 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787263.220224:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787263.220332:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a09e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+9:2344:x1874630678681216:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 203us (9459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787263.220341:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 23 00000100:00100000:2.0:1787787263.220361:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787787263.220368:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0708b58f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1500c007-b35b-4004-b231-bb5a7ec082ef+17:3293:x1874630694438016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787787263.220376:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787263.220381:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d072212ba00/0xdeb1953cba4b0f34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b0f2d expref: 17 pid: 5814 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787263.220391:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d072212ba00/0xdeb1953cba4b0f34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b0f2d expref: 17 pid: 5814 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787263.220403:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d072212ba00/0xdeb1953cba4b0f34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b0f2d expref: 17 pid: 5814 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787263.220415:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b10f4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787263.220424:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b10f4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787263.220462:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b10f4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787263.220470:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b10f4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787263.220477:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b10f4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787263.220486:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b10f4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787263.220500:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0700031a00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:2.0:1787787263.220505:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b10f4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787263.220521:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b10f4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787263.220541:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b10f4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787263.220554:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787263.220640:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0708b58f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1500c007-b35b-4004-b231-bb5a7ec082ef+16:3293:x1874630694438016:12345-0@lo:103:ldlm_bl.0 Request processed in 272us (3246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787263.220647:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1787787263.220916:0:8494:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b10f4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787263.220925:0:8494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b10f4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787263.220932:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b10f4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787263.222718:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694438016:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787787263.614331:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787263.842867:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787263.842995:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678681344 00000100:00100000:1.0:1787787263.843009:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678681344 00000100:00100000:1.0:1787787263.843086:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 171 00000100:00100000:1.0:1787787263.843098:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703092050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+9:5584:x1874630678681344:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787263.843120:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787263.843148:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d072212a600/0xdeb1953cba4b10fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c34fb4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787263.843207:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d072212a600/0xdeb1953cba4b10fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34fb4 expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787263.843234:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d072212a600/0xdeb1953cba4b10fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34fb4 expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787263.843245:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d072212a600, rc 0) 00000100:00100000:1.0:1787787263.843322:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703092050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:5584:x1874630678681344:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 Request processed in 227us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787263.843330:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 171 00000100:00100000:2.0:1787787263.846158:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787263.846264:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678681472 00000100:00100000:3.0:1787787263.846276:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678681472 00000100:00100000:3.0:1787787263.846360:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 172 00000100:00100000:3.0:1787787263.846371:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:5584:x1874630678681472:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787263.846762:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:5584:x1874630678681472:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 Request processed in 391us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787263.846772:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 172 00000100:00100000:2.0:1787787263.864176:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787263.864768:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678681600 00000100:00100000:3.0:1787787263.864783:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678681600 00000100:00100000:3.0:1787787263.864956:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 173 00000100:00100000:3.0:1787787263.864971:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703090850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:5584:x1874630678681600:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787787263.865290:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703090850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:5584:x1874630678681600:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 Request processed in 322us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787263.865299:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 173 00000100:00100000:2.0:1787787263.868761:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787787263.868791:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694438400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787263.868884:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787263.869701:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694438400 00000100:00100000:2.0:1787787263.869726:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694438400 00000100:00100000:2.0:1787787263.869791:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787787263.870844:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a08f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694438400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787787263.871103:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787263.871222:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a08f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694438400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1420us (2336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787263.871234:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1787787263.873204:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0707a09680 x1874630694438400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787263.873240:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694438400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787787263.874510:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787263.874551:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678681728 00000100:00100000:3.0:1787787263.874560:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678681728 00000100:00100000:3.0:1787787263.874612:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 174 00000100:00100000:3.0:1787787263.874623:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:6132:x1874630678681728:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787787263.875613:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:6132:x1874630678681728:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 983us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787263.875634:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 174 00000100:00100000:3.0:1787787263.884373:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787263.884711:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678681856 00000100:00100000:0.0:1787787263.884724:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678681856 00000100:00100000:0.0:1787787263.884798:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 175 00000100:00100000:0.0:1787787263.884809:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:6132:x1874630678681856:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787787263.885143:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:6132:x1874630678681856:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 334us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787263.885153:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 175 00000100:00100000:2.0:1787787263.972962:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787263.973052:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678681984 00000100:00100000:0.0:1787787263.973078:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678681984 00000100:00100000:0.0:1787787263.973220:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 32 00000100:00100000:0.0:1787787263.973232:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2345:x1874630678681984:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787787263.973308:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2345:x1874630678681984:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 78us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787263.973319:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 32 00000100:00080000:1.0:1787787263.973535:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787263.980742:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787263.980803:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678682112 00000100:00100000:2.0:1787787263.980812:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678682112 00000100:00080000:0.0:1787787263.980893:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787263.981047:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:2.0:1787787263.981058:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2345:x1874630678682112:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787787263.981150:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2345:x1874630678682112:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 93us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787263.981158:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:0.0:1787787263.982770:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787263.982930:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678682240 00000100:00100000:3.0:1787787263.982938:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678682240 00000100:00100000:3.0:1787787263.982992:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:3.0:1787787263.983001:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073475d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2345:x1874630678682240:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787263.983056:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073475d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2345:x1874630678682240:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 57us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787263.983075:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00080000:0.0:1787787263.986111:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:1.0:1787787264.573507:0:5817:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787787264.573514:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d070598a000 from 4 10000000:01000000:1.0:1787787264.573519:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787787264.573560:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d072212a800/0xdeb1953cba4b1102 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787264.573571:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d072212a800/0xdeb1953cba4b1102 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787264.573582:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d072212a800/0xdeb1953cba4b1102 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787264.573616:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0708b59a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694438528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787787264.573680:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787264.573728:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071046cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787787264.574682:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694438528 00000100:00100000:3.0:1787787264.574692:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694438528 00000100:00100000:3.0:1787787264.574788:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787787264.574799:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703090050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+16:5817:x1874630694438528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787787264.574813:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787264.574828:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0708770200/0xdeb1953cba4b1109 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b1102 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787264.574853:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0708770200/0xdeb1953cba4b1109 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b1102 expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787264.574865:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0708770200/0xdeb1953cba4b1109 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b1102 expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787264.574873:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708770200, rc 0) 00000100:00100000:3.0:1787787264.574927:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703090050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+17:5817:x1874630694438528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (1247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787264.574946:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787787264.575307:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0708b59a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694438528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787264.575326:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d072212a800/0xdeb1953cba4b1102 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b1109 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787264.575337:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d072212a800/0xdeb1953cba4b1102 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b1109 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787264.575403:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694438656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787264.575580:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787264.575654:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0737e60cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787264.575872:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694438656 00000100:00100000:3.0:1787787264.575879:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694438656 00000100:00100000:3.0:1787787264.575917:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787787264.575925:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+17:5817:x1874630694438656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787264.576325:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+17:5817:x1874630694438656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 400us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787264.576333:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787787264.576508:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694438656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787264.576593:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073475c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694438784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787787264.576636:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787264.576657:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0707d41000 going to sleep for 11 seconds 00000100:00100000:2.0:1787787264.576919:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694438784 00000100:00100000:2.0:1787787264.576925:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694438784 00000100:00100000:2.0:1787787264.576949:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787787264.576957:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+17:5817:x1874630694438784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787264.577473:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+17:5817:x1874630694438784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 516us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787264.577487:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787787264.578009:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073475c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694438784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787787264.578526:0:8550:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073473e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8550:1874630694438912:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787787264.578576:0:8550:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787264.578855:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694438912 00000100:00100000:0.0:1787787264.578861:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694438912 00000100:00100000:0.0:1787787264.578975:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787787264.578984:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+17:8550:x1874630694438912:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787787264.579742:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+17:8550:x1874630694438912:12345-0@lo:502:llog_process_th.0 Request processed in 756us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787264.579751:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787787264.585582:0:8550:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0706b11f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787787264.585855:0:8550:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073473e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8550:1874630694438912:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787787264.585896:0:8550:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787264.585908:0:8550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787264.585910:0:8550:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787787264.585916:0:8550:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d070598a000 00000020:00000080:3.0:1787787264.585919:0:8550:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787787264.586016:0:8550:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073473e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8550:1874630694439040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787787264.590362:0:8550:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787264.590401:0:8550:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0706b11f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787787264.591168:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694439040 00000100:00100000:0.0:1787787264.591177:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694439040 00000100:00100000:0.0:1787787264.608112:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787787264.608133:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+17:8550:x1874630694439040:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787787264.608414:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+17:8550:x1874630694439040:12345-0@lo:502:llog_process_th.0 Request processed in 289us (18056us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787264.608423:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787787264.608622:0:8550:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073473e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8550:1874630694439040:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787787264.608658:0:8550:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787264.608665:0:8550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787264.608668:0:8550:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787787264.608672:0:8550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787787264.611578:0:5817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787787264.612087:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787787264.612099:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d072212a800/0xdeb1953cba4b1102 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b1109 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787264.612112:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d072212a800/0xdeb1953cba4b1102 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b1109 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787264.612195:0:5817:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787787264.612198:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d0707278800 from 4 10000000:01000000:0.0:1787787264.612202:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787787264.612241:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0700031c00/0xdeb1953cba4b1110 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787264.612249:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d0700031c00/0xdeb1953cba4b1110 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787264.612259:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d0700031c00/0xdeb1953cba4b1110 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787264.612284:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073475c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694439168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787787264.612345:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787264.612392:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0707d41840 going to sleep for 11 seconds 00000100:00100000:0.0:1787787264.612416:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694439168 00000100:00100000:0.0:1787787264.612422:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694439168 00000100:00100000:0.0:1787787264.612503:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787787264.612512:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+17:5817:x1874630694439168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787264.613008:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787264.613024:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b1117 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b1110 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787264.613050:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b1117 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b1110 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787264.613070:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b1117 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b1110 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787264.613079:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0700031a00, rc 0) 00000100:00100000:0.0:1787787264.613123:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+18:5817:x1874630694439168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 612us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787264.613131:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787787264.613416:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073475c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694439168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787264.613432:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d0700031c00/0xdeb1953cba4b1110 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b1117 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787264.613474:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d0700031c00/0xdeb1953cba4b1110 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b1117 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787264.613530:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073475c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694439296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787264.613556:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787264.613579:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0707d41840 going to sleep for 11 seconds 00000100:00100000:0.0:1787787264.613899:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694439296 00000100:00100000:0.0:1787787264.613905:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694439296 00000100:00100000:0.0:1787787264.613940:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787787264.613948:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+18:5817:x1874630694439296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787264.614198:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+18:5817:x1874630694439296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787264.614205:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787787264.614242:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073475c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694439296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787264.614272:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073475c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694439424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787787264.614308:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787264.614322:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0707d41840 going to sleep for 11 seconds 00000100:00100000:0.0:1787787264.614333:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694439424 00000100:00100000:0.0:1787787264.614336:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694439424 00000100:00100000:0.0:1787787264.614352:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787787264.614357:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+18:5817:x1874630694439424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787787264.614521:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+18:5817:x1874630694439424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787264.614528:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787787264.614562:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073475c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694439424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787787264.617021:0:8555:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073475c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8555:1874630694439552:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787787264.617106:0:8555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787264.617153:0:8555:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0707d41d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787787264.618113:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694439552 00000100:00100000:1.0:1787787264.618122:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694439552 00000100:00100000:1.0:1787787264.618254:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787787264.618265:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+18:8555:x1874630694439552:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787264.618510:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+18:8555:x1874630694439552:12345-0@lo:502:llog_process_th.0 Request processed in 247us (1404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787264.618578:0:8555:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073475c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8555:1874630694439552:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787787264.619191:0:8555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787264.619204:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787264.619207:0:8555:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787787264.619214:0:8555:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d0707278800 00000020:00000080:0.0:1787787264.619217:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787787264.619308:0:8555:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073475c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8555:1874630694439680:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787264.619366:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787787264.626260:0:8555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787264.626317:0:8555:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0707d41d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787787264.626429:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694439680 00000100:00100000:3.0:1787787264.626842:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694439680 00000100:00100000:3.0:1787787264.627523:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787787264.627539:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+18:8555:x1874630694439680:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787787264.628301:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+18:8555:x1874630694439680:12345-0@lo:502:llog_process_th.0 Request processed in 764us (2042us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787264.628311:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787787264.628545:0:8555:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073475c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8555:1874630694439680:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787787264.628581:0:8555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787264.628588:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787264.628591:0:8555:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787787264.628596:0:8555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787787264.629333:0:5817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787787264.629361:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787787264.629371:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0700031c00/0xdeb1953cba4b1110 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b1117 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787264.629382:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d0700031c00/0xdeb1953cba4b1110 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b1117 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787264.629392:0:5817:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787787264.629395:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d0722109800 from 4 10000000:01000000:2.0:1787787264.629397:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787787264.629429:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0701647800/0xdeb1953cba4b111e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787264.629451:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d0701647800/0xdeb1953cba4b111e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787264.629461:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d0701647800/0xdeb1953cba4b111e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787264.629481:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694439808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787787264.630278:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787264.630332:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0737e60480 going to sleep for 11 seconds 00000100:00100000:3.0:1787787264.630429:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694439808 00000100:00100000:3.0:1787787264.630531:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694439808 00000100:00100000:3.0:1787787264.630575:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787787264.630584:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+18:5817:x1874630694439808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787787264.630598:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787264.630613:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0708770000/0xdeb1953cba4b1125 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b111e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787264.630638:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0708770000/0xdeb1953cba4b1125 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b111e expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787264.630649:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0708770000/0xdeb1953cba4b1125 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b111e expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787264.630658:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708770000, rc 0) 00000100:00100000:3.0:1787787264.630968:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:5817:x1874630694439808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787264.630977:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787787264.631293:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694439808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787264.631310:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d0701647800/0xdeb1953cba4b111e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b1125 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787264.631320:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d0701647800/0xdeb1953cba4b111e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b1125 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787264.631377:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694439936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787264.631407:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787264.631450:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0737e60480 going to sleep for 11 seconds 00000100:00100000:2.0:1787787264.631464:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694439936 00000100:00100000:2.0:1787787264.631467:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694439936 00000100:00100000:2.0:1787787264.631491:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787787264.631497:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:5817:x1874630694439936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787264.631760:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:5817:x1874630694439936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 262us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787264.631767:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787787264.631795:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694439936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787264.631828:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073473e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694440064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787787264.631872:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787264.631915:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07094a1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787787264.636071:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694440064 00000100:00100000:2.0:1787787264.636093:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694440064 00000100:00100000:2.0:1787787264.636186:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787787264.636201:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+19:5817:x1874630694440064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787264.636913:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+19:5817:x1874630694440064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 710us (5035us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787264.636926:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787787264.639613:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073473e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694440064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787264.640145:0:8559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a083c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8559:1874630694440192:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787264.640241:0:8559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787264.640295:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694440192 00000100:00100000:2.0:1787787264.640302:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694440192 00000100:00100000:2.0:1787787264.640364:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787787264.640375:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:8559:x1874630694440192:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787264.640730:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:8559:x1874630694440192:12345-0@lo:502:llog_process_th.0 Request processed in 356us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787264.640739:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00010000:00010000:3.0:1787787264.640846:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787264.641176:0:8559:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0737e60180 going to sleep for 11 seconds 00000100:00100000:2.0:1787787264.641205:0:8559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a083c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8559:1874630694440192:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787787264.641245:0:8559:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787787264.641258:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787264.641260:0:8559:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787787264.641269:0:8559:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d0722109800 00000020:00000080:2.0:1787787264.641272:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787787264.641384:0:8559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a083c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8559:1874630694440320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787264.641965:0:8559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787264.642111:0:8559:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0737e60180 going to sleep for 11 seconds 00000100:00100000:3.0:1787787264.642150:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694440320 00000100:00100000:3.0:1787787264.642163:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694440320 00000100:00100000:3.0:1787787264.642221:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787787264.642231:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+19:8559:x1874630694440320:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787787264.642476:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+19:8559:x1874630694440320:12345-0@lo:502:llog_process_th.0 Request processed in 246us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787264.642499:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787787264.642536:0:8559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a083c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:8559:1874630694440320:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787787264.642736:0:8559:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787787264.642746:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787264.642748:0:8559:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787787264.642754:0:8559:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787787264.643345:0:5817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787787264.643372:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787787264.643382:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0701647800/0xdeb1953cba4b111e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b1125 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787264.643392:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d0701647800/0xdeb1953cba4b111e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b1125 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787265.660641:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787266.684754:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787267.458485:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0708b5b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874630694440576:0@lo:400:kworker.0 00000100:00100000:1.0:1787787267.458578:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787267.458643:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0708b58b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694441088:0@lo:400:kworker.0 00000100:00100000:1.0:1787787267.458675:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787267.458728:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787787267.458735:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0708b5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694440448:0@lo:400:kworker.0 00000100:00100000:1.0:1787787267.458769:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787267.459107:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0708b58780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1874630694440960:0@lo:400:kworker.0 00000100:00100000:1.0:1787787267.459135:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787267.459168:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0708b5a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694440704:0@lo:400:kworker.0 00000100:00100000:1.0:1787787267.459194:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787267.459216:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787787267.459221:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0708b5a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694440832:0@lo:400:kworker.0 00000100:00100000:1.0:1787787267.459243:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787267.459289:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694440576 00000100:00100000:1.0:1787787267.459299:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694440576 00000100:00100000:1.0:1787787267.459346:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694440960 00000100:00100000:1.0:1787787267.459349:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694440960 00000100:00100000:1.0:1787787267.459376:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694440704 00000100:00100000:1.0:1787787267.459379:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694440704 00000100:00100000:1.0:1787787267.459400:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787787267.459410:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0708b59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874630694440576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787267.459522:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0708b59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874630694440576:12345-0@lo:400:kworker.0 Request processed in 113us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787267.459531:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787787267.459552:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787787267.459559:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0708b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874630694440960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787267.459587:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0708b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874630694440960:12345-0@lo:400:kworker.0 Request processed in 29us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787267.459593:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787787267.459604:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787787267.459609:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0708b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694440704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787267.459637:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0708b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694440704:12345-0@lo:400:kworker.0 Request processed in 28us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787267.459643:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787787267.459662:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694441088 00000100:00100000:1.0:1787787267.459665:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694441088 00000100:00100000:1.0:1787787267.461056:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694440832 00000100:00100000:1.0:1787787267.461070:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694440832 00000100:00100000:1.0:1787787267.461114:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787787267.461124:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0708b5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694441088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787267.461211:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0708b5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694441088:12345-0@lo:400:kworker.0 Request processed in 89us (2534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787267.461219:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787787267.461236:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787787267.461242:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0708b592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694440832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787267.461278:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0708b592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694440832:12345-0@lo:400:kworker.0 Request processed in 36us (2033us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787267.461298:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1787787267.461339:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787787267.461343:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787787267.461347:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787787267.461394:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0708b58780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1874630694440960:0@lo:400:kworker.0 00000100:00100000:1.0:1787787267.461410:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0708b5b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874630694440576:0@lo:400:kworker.0 00010000:00080000:1.0:1787787267.461425:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0708b58b40 x1874630694441088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787267.461456:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0708b58b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694441088:0@lo:400:kworker.0 00010000:00080000:1.0:1787787267.461504:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0708b5a940 x1874630694440832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787267.461515:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0708b5a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694440832:0@lo:400:kworker.0 00000100:00100000:1.0:1787787267.461528:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0708b5a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694440704:0@lo:400:kworker.0 00000100:00100000:2.0:1787787267.463181:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694440448 00000100:00100000:2.0:1787787267.463201:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694440448 00000100:00100000:2.0:1787787267.463282:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787787267.463293:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3294:x1874630694440448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787267.463399:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3294:x1874630694440448:12345-0@lo:400:kworker.0 Request processed in 108us (4628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787267.463408:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787787267.464021:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0708b5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694440448:0@lo:400:kworker.0 00010000:00010000:1.0:1787787267.708864:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787267.966203:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694441216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787787267.966291:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787267.966355:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694441216 00000100:00100000:2.0:1787787267.966362:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694441216 00000100:00100000:2.0:1787787267.966404:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787787267.966412:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694441216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787787267.966459:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787267.966503:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694441216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787267.966510:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1787787267.966548:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0707a0ad00 x1874630694441216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787267.966566:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694441216:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787787268.733133:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787268.989370:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787787268.989391:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073473e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694441344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787787268.989604:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787268.989662:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694441344 00000100:00100000:3.0:1787787268.989669:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694441344 00000100:00100000:3.0:1787787268.989712:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787787268.989720:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07222a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694441344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787787268.989764:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787787268.989809:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07222a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694441344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787268.989824:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1787787268.989989:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d073473e940 x1874630694441344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787268.990007:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073473e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694441344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787269.095120:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787269.095162:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787269.095193:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787269.095219:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787269.095286:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678682496 00000100:00100000:1.0:1787787269.095297:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678682496 00000100:00100000:1.0:1787787269.095365:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 36 00000100:00100000:1.0:1787787269.095374:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2343:x1874630678682496:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787787269.095461:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2343:x1874630678682496:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 88us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787269.095469:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 36 00000100:00100000:1.0:1787787269.095491:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678682624 00000100:00100000:1.0:1787787269.095500:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678682624 00000100:00100000:1.0:1787787269.095525:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678682752 00000100:00100000:1.0:1787787269.095528:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678682752 00000100:00100000:1.0:1787787269.095545:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 19 00000100:00100000:1.0:1787787269.095552:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2342:x1874630678682624:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787787269.095580:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2342:x1874630678682624:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 28us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787269.095586:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 19 00000100:00100000:1.0:1787787269.095598:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 20 00000100:00100000:1.0:1787787269.095605:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2343:x1874630678682752:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787787269.095628:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2343:x1874630678682752:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 24us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787269.095635:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 20 00000100:00080000:2.0:1787787269.095814:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787787269.095819:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787787269.095827:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787269.095949:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678682368 00000100:00100000:3.0:1787787269.095954:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678682368 00000100:00100000:3.0:1787787269.096024:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 192 00000100:00100000:3.0:1787787269.096042:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:2342:x1874630678682368:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787269.096086:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:2342:x1874630678682368:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 54us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787269.096093:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 192 00000001:02000400:2.0:1787787269.284305:0:8795:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1787787269.756659:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787270.780717:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787271.806930:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787272.579860:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073475de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694441472:0@lo:400:kworker.0 00000100:00100000:1.0:1787787272.579935:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787272.580031:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694441472 00000100:00100000:3.0:1787787272.580039:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694441472 00000100:00100000:3.0:1787787272.580089:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787787272.580098:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3293:x1874630694441472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787272.590879:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3293:x1874630694441472:12345-0@lo:400:kworker.0 Request processed in 10771us (10933us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787272.590893:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787787272.591404:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073475de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694441472:0@lo:400:kworker.0 00000100:00100000:1.0:1787787272.591429:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787787272.591453:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073475cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874630694441600:0@lo:400:kworker.0 00000100:00100000:1.0:1787787272.591507:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787272.591553:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694441600 00000100:00100000:1.0:1787787272.591559:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694441600 00000100:00100000:1.0:1787787272.591600:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787787272.591609:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0708b5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874630694441600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787272.592810:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0708b5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874630694441600:12345-0@lo:400:kworker.0 Request processed in 1196us (1297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787272.592836:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787787272.592891:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073475cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874630694441600:0@lo:400:kworker.0 00000100:00100000:1.0:1787787272.594134:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073475f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1874630694441984:0@lo:400:kworker.0 00000100:00100000:1.0:1787787272.594194:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787272.594226:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787787272.594233:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073475e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694442112:0@lo:400:kworker.0 00000100:00100000:1.0:1787787272.594259:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787272.594299:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073475c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694441856:0@lo:400:kworker.0 00000100:00100000:1.0:1787787272.594324:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787272.594356:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787787272.594362:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073475f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1874630694441728:0@lo:400:kworker.0 00000100:00100000:1.0:1787787272.594384:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787272.594417:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694441984 00000100:00100000:1.0:1787787272.594424:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694441984 00000100:00100000:1.0:1787787272.594501:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694441728 00000100:00100000:1.0:1787787272.594504:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694441728 00000100:00100000:1.0:1787787272.594523:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787787272.594530:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0708b5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874630694441984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787272.594594:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0708b5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874630694441984:12345-0@lo:400:kworker.0 Request processed in 64us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787272.594601:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787787272.594616:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787787272.594622:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0708b5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1874630694441728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787272.594654:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0708b5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1874630694441728:12345-0@lo:400:kworker.0 Request processed in 33us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787272.594674:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787787272.594698:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694442112 00000100:00100000:1.0:1787787272.594703:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694442112 00000100:00100000:1.0:1787787272.594731:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694441856 00000100:00100000:1.0:1787787272.594735:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694441856 00000100:00100000:1.0:1787787272.594751:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787787272.594756:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0708b5a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694442112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787272.594791:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0708b5a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694442112:12345-0@lo:400:kworker.0 Request processed in 35us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787272.594800:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787787272.594811:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787787272.594818:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0708b58b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694441856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787272.594845:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0708b58b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694441856:12345-0@lo:400:kworker.0 Request processed in 28us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787272.594852:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1787787272.594873:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787787272.594877:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787787272.594879:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787787272.594905:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d073475e1c0 x1874630694442112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787272.594918:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073475e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694442112:0@lo:400:kworker.0 00000100:00100000:1.0:1787787272.594928:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073475f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1874630694441984:0@lo:400:kworker.0 00000100:00100000:1.0:1787787272.594951:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073475f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1874630694441728:0@lo:400:kworker.0 00010000:00080000:1.0:1787787272.594958:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d073475c000 x1874630694441856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787272.594990:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073475c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694441856:0@lo:400:kworker.0 00010000:00010000:3.0:1787787272.828885:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787273.084726:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787787273.084756:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694442240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787787273.084863:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787273.085182:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694442240 00000100:00100000:3.0:1787787273.085193:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694442240 00000100:00100000:3.0:1787787273.085261:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787787273.085272:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694442240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787787273.085325:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787787273.085386:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694442240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787273.085394:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1787787273.085469:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0707a08780 x1874630694442240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787273.085489:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694442240:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787787273.854594:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787787273.862569:0:9039:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing yml_node 00000100:00100000:2.0:1787787274.109364:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787787274.109395:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694442368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787274.109508:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787274.109592:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694442368 00000100:00100000:2.0:1787787274.109602:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694442368 00000100:00100000:2.0:1787787274.109674:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787787274.109684:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a0a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694442368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787787274.109730:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787274.109783:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a0a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694442368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787274.109792:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1787787274.109816:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787787274.109852:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0707a0b840 x1874630694442368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787290 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787274.109873:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694442368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787787274.218356:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787274.218413:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787274.219040:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678682880 00000100:00100000:0.0:1787787274.219053:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678682880 00000100:00100000:0.0:1787787274.219119:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 194 00000100:00100000:0.0:1787787274.219130:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:2342:x1874630678682880:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787787274.219356:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:2342:x1874630678682880:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 226us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787274.219365:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 194 00000100:00100000:1.0:1787787274.220278:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678683008 00000100:00100000:1.0:1787787274.220289:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678683008 00000100:00100000:1.0:1787787274.220405:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 40 00000100:00100000:1.0:1787787274.220415:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2342:x1874630678683008:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787787274.220519:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2342:x1874630678683008:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 105us (2104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787274.220526:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 40 00000100:00080000:3.0:1787787274.226119:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787274.230287:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787274.230346:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787274.230383:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678683136 00000100:00100000:0.0:1787787274.230396:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678683136 00000100:00100000:0.0:1787787274.230490:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678683264 00000100:00100000:0.0:1787787274.230493:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678683264 00000100:00100000:0.0:1787787274.230518:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:0.0:1787787274.230529:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073475d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2341:x1874630678683136:12345-192.168.206.10@tcp:9:kworker.0 00000020:00000080:0.0:1787787274.230579:0:6674:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b1061 00000100:00080000:0.0:1787787274.230591:0:6674:0:(import.c:65:import_set_state_nolock()) ffff9d073d8aa800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787787274.230638:0:6674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787787274.231361:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073475d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+2:2341:x1874630678683136:12345-192.168.206.10@tcp:9:kworker.0 Request processed in 829us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787274.231386:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:0.0:1787787274.231408:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:0.0:1787787274.231416:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073475ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2341:x1874630678683264:12345-192.168.206.10@tcp:9:kworker.0 00000020:00000080:0.0:1787787274.231966:0:6674:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b1068 00000100:00080000:0.0:1787787274.232065:0:6674:0:(import.c:65:import_set_state_nolock()) ffff9d073d8ae800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787787274.232158:0:6674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787787274.232507:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073475ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+2:2341:x1874630678683264:12345-192.168.206.10@tcp:9:kworker.0 Request processed in 1088us (2156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787274.232518:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00080000:1.0:1787787274.234468:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787787274.234480:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787787274.236118:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787274.244675:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787787274.692626:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c5599457-aa74-4a71-951f-faabe33e6ec7 00000020:00000080:2.0:1787787274.692638:0:6697:0:(genops.c:885:class_export_put()) final put ffff9d073d8ab800/c5599457-aa74-4a71-951f-faabe33e6ec7 00000020:00000080:2.0:1787787274.692683:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d073d8ab800/c5599457-aa74-4a71-951f-faabe33e6ec7 for lustre-OST0000 00000020:00000080:2.0:1787787274.692731:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d073d8aa800 for lustre-OST0000 00010000:00010000:3.0:1787787274.877689:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787275.900784:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787276.926005:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787277.700076:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694442496:0@lo:400:kworker.0 00000100:00100000:3.0:1787787277.700181:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787277.700271:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694442496 00000100:00100000:3.0:1787787277.700280:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694442496 00000100:00100000:3.0:1787787277.700339:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787787277.700350:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3293:x1874630694442496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787277.700409:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3293:x1874630694442496:12345-0@lo:400:kworker.0 Request processed in 60us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787277.700417:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787787277.700504:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694442496:0@lo:400:kworker.0 00000100:00100000:3.0:1787787277.700575:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874630694442624:0@lo:400:kworker.0 00000100:00100000:3.0:1787787277.700612:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787277.700664:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694442752:0@lo:400:kworker.0 00000100:00100000:3.0:1787787277.700675:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07185a2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694443136:0@lo:400:kworker.0 00000100:00100000:2.0:1787787277.700710:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787277.700721:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787277.700742:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787787277.700751:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787787277.700753:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694442880:0@lo:400:kworker.0 00000100:00100000:3.0:1787787277.700761:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1874630694443008:0@lo:400:kworker.0 00000100:00100000:2.0:1787787277.700788:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787277.700800:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787277.700840:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694442624 00000100:00100000:3.0:1787787277.700845:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694442624 00000100:00100000:3.0:1787787277.700870:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694442752 00000100:00100000:3.0:1787787277.700872:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694442752 00000100:00100000:3.0:1787787277.700897:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694443008 00000100:00100000:3.0:1787787277.700900:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694443008 00000100:00100000:3.0:1787787277.700915:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787787277.700921:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874630694442624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787277.700959:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874630694442624:12345-0@lo:400:kworker.0 Request processed in 39us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787277.700966:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787787277.700978:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787787277.700996:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787787277.701002:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07185a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694442752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787277.701009:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0711574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874630694443008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787277.701056:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0711574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874630694443008:12345-0@lo:400:kworker.0 Request processed in 53us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787277.701065:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07185a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694442752:12345-0@lo:400:kworker.0 Request processed in 76us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787277.701068:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787787277.701078:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787787277.701094:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694443136 00000100:00100000:3.0:1787787277.701099:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694443136 00000100:00100000:3.0:1787787277.701127:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694442880 00000100:00100000:3.0:1787787277.701130:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694442880 00000100:00100000:3.0:1787787277.701144:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787787277.701151:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0711577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694443136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787277.701181:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0711577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694443136:12345-0@lo:400:kworker.0 Request processed in 31us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787277.701194:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787787277.701205:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787787277.701211:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07185a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694442880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787277.701240:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07185a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694442880:12345-0@lo:400:kworker.0 Request processed in 29us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787277.701245:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1787787277.701264:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787787277.701269:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787787277.701272:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787277.701309:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1874630694443008:0@lo:400:kworker.0 00010000:00080000:3.0:1787787277.701324:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d07185a2d00 x1874630694443136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787277.701336:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07185a2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694443136:0@lo:400:kworker.0 00000100:00100000:3.0:1787787277.701348:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874630694442624:0@lo:400:kworker.0 00010000:00080000:3.0:1787787277.705854:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0707a083c0 x1874630694442880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787277.705879:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694442880:0@lo:400:kworker.0 00000100:00100000:3.0:1787787277.705911:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694442752:0@lo:400:kworker.0 00000001:02000400:3.0:1787787277.782819:0:9231:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.52 00010000:00010000:0.0:1787787277.948860:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787278.213180:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07185a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694443264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787787278.213250:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787278.213742:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694443264 00000100:00100000:0.0:1787787278.213750:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694443264 00000100:00100000:0.0:1787787278.213796:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787787278.213806:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07185a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694443264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787787278.213839:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787787278.213894:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07185a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694443264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787278.213903:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1787787278.213933:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d07185a3480 x1874630694443264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787278.213952:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07185a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694443264:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1787787278.250014:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c5599457-aa74-4a71-951f-faabe33e6ec7 00000020:00000080:2.0:1787787278.250027:0:7630:0:(genops.c:885:class_export_put()) final put ffff9d073d8ab000/c5599457-aa74-4a71-951f-faabe33e6ec7 00000020:00000080:3.0:1787787278.250124:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d073d8ab000/c5599457-aa74-4a71-951f-faabe33e6ec7 for lustre-OST0001 00000020:00000080:3.0:1787787278.250267:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d073d8ae800 for lustre-OST0001 00010000:00010000:3.0:1787787278.973586:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787279.228698:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07185a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694443392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787787279.228768:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787279.229109:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694443392 00000100:00100000:2.0:1787787279.229119:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694443392 00000100:00100000:2.0:1787787279.229196:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787787279.229206:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073475c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694443392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787787279.229239:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787279.229298:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073475c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694443392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787279.229305:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1787787279.229384:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787787279.229489:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d07185a3480 x1874630694443392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787279.229509:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07185a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694443392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787279.334379:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787279.334492:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787279.334574:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678683520 00000100:00100000:1.0:1787787279.334583:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678683520 00000100:00100000:1.0:1787787279.334663:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 44 00000100:00100000:1.0:1787787279.334673:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07185a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2343:x1874630678683520:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787787279.334751:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07185a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2343:x1874630678683520:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 79us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787279.334758:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 44 00000100:00080000:2.0:1787787279.335392:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787279.335505:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678683392 00000100:00100000:3.0:1787787279.335525:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678683392 00000100:00100000:3.0:1787787279.335607:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 196 00000100:00100000:3.0:1787787279.335616:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:2342:x1874630678683392:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787279.335673:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:2342:x1874630678683392:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 58us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787279.335680:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 196 00010000:00010000:2.0:1787787279.996622:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787787280.163540:0:9331:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.52 00010000:00010000:3.0:1787787281.025309:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787282.045009:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787787282.543475:0:9428:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.52 00000100:00100000:1.0:1787787282.814598:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073475e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694443904:0@lo:400:kworker.0 00000100:00100000:0.0:1787787282.814598:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073475f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694443776:0@lo:400:kworker.0 00000100:00100000:2.0:1787787282.814610:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073475f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874630694443648:0@lo:400:kworker.0 00000100:00100000:3.0:1787787282.814680:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073475c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694443520:0@lo:400:kworker.0 00000100:00100000:0.0:1787787282.815553:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787282.817455:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694443776 00000100:00100000:0.0:1787787282.817469:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694443776 00000100:00100000:0.0:1787787282.817542:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787787282.817555:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073475cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694443776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787282.817797:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073475cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694443776:12345-0@lo:400:kworker.0 Request processed in 246us (2247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787282.817805:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787787282.817859:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073475f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694443776:0@lo:400:kworker.0 00000100:00100000:1.0:1787787282.819630:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787787282.819646:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787282.819669:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694443904 00000100:00100000:3.0:1787787282.819679:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694443904 00000100:00100000:3.0:1787787282.819739:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787787282.819752:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0708b5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694443904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787282.819820:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0708b5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694443904:12345-0@lo:400:kworker.0 Request processed in 72us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787282.819828:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1787787282.819847:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787787282.819923:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d073475e1c0 x1874630694443904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787282.820011:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787282.820049:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073475cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1874630694444032:0@lo:400:kworker.0 00000100:00100000:1.0:1787787282.820074:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073475e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694443904:0@lo:400:kworker.0 00000100:00100000:0.0:1787787282.820081:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787282.820104:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694444032 00000100:00100000:0.0:1787787282.820108:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694444032 00000100:00080000:1.0:1787787282.820138:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787282.820141:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787787282.820147:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073475f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874630694444032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787282.820188:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073475f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874630694444032:12345-0@lo:400:kworker.0 Request processed in 42us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787282.820199:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787787282.820328:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694443520 00000100:00100000:3.0:1787787282.820332:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694443520 00000100:00100000:3.0:1787787282.820364:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787787282.820371:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3293:x1874630694443520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787282.820402:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3293:x1874630694443520:12345-0@lo:400:kworker.0 Request processed in 32us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787282.820408:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787787282.820433:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787282.820493:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073475de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694444160:0@lo:400:kworker.0 00000100:00100000:3.0:1787787282.820507:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694443648 00000100:00100000:3.0:1787787282.820513:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694443648 00000100:00100000:2.0:1787787282.820526:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787282.820563:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694444160 00000100:00100000:2.0:1787787282.820567:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694444160 00000100:00100000:3.0:1787787282.820586:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787787282.820607:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787787282.820609:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07185a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874630694443648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787282.820619:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07185a3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694444160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787282.820657:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07185a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874630694443648:12345-0@lo:400:kworker.0 Request processed in 54us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787282.820667:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787787282.820668:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07185a3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694444160:12345-0@lo:400:kworker.0 Request processed in 50us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787282.820677:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787787282.820712:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073475f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874630694443648:0@lo:400:kworker.0 00010000:00080000:2.0:1787787282.820725:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d073475de00 x1874630694444160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787282.820735:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073475de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694444160:0@lo:400:kworker.0 00000100:00100000:0.0:1787787282.822603:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073475c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694443520:0@lo:400:kworker.0 00000100:00100000:0.0:1787787282.822630:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073475cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1874630694444032:0@lo:400:kworker.0 00000100:00080000:1.0:1787787282.822726:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787787283.069106:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787283.325900:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787787283.325933:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07185a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694444288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787787283.326037:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787283.326129:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694444288 00000100:00100000:1.0:1787787283.326138:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694444288 00000100:00100000:1.0:1787787283.326204:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787787283.326214:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0708b59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694444288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787787283.326257:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787787283.326320:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0708b59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694444288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787283.326327:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1787787283.326375:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d07185a2580 x1874630694444288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787283.326397:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07185a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694444288:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1787787283.886339:0:9476:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Aug 26 19:34:42 EDT 2026 00010000:00010000:2.0:1787787284.092659:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787284.348734:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07185a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694444416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787787284.348810:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787284.348946:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694444416 00000100:00100000:2.0:1787787284.348966:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694444416 00000100:00100000:2.0:1787787284.349026:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787787284.349035:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0708b58780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694444416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787787284.349082:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787284.349138:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0708b58780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694444416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787284.349145:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1787787284.349203:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d07185a2940 x1874630694444416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787300 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787284.349226:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07185a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694444416:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787787284.349258:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787284.450183:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787284.450269:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787284.450636:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678683776 00000100:00100000:1.0:1787787284.450646:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678683776 00000100:00100000:1.0:1787787284.450713:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 48 00000100:00100000:1.0:1787787284.450724:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07185a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2344:x1874630678683776:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787787284.450791:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07185a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2344:x1874630678683776:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 70us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787284.450806:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 48 00000100:00080000:0.0:1787787284.451414:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787284.455770:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678683648 00000100:00100000:3.0:1787787284.455784:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678683648 00000100:00100000:3.0:1787787284.455882:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 198 00000100:00100000:3.0:1787787284.455894:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:2344:x1874630678683648:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787284.455989:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:2344:x1874630678683648:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 97us (5813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787284.455997:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 198 00010000:00010000:3.0:1787787285.117229:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787286.141555:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787287.166713:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787287.936244:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07185a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694444544:0@lo:400:kworker.0 00000100:00100000:0.0:1787787287.936337:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787287.936462:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694444544 00000100:00100000:1.0:1787787287.936472:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694444544 00000100:00100000:1.0:1787787287.936532:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787787287.936542:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3293:x1874630694444544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787287.941830:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07185a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694444544:0@lo:400:kworker.0 00000100:00100000:0.0:1787787287.941870:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787787287.941883:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07185a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874630694444672:0@lo:400:kworker.0 00000100:00100000:2.0:1787787287.942033:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07185a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694445184:0@lo:400:kworker.0 00000100:00100000:2.0:1787787287.942094:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787287.942131:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787787287.942137:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07185a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1874630694445056:0@lo:400:kworker.0 00000100:00100000:2.0:1787787287.942170:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787287.942205:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694445184 00000100:00100000:2.0:1787787287.942212:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694445184 00000100:00100000:0.0:1787787287.942226:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787287.942255:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07185a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694444800:0@lo:400:kworker.0 00000100:00100000:2.0:1787787287.942273:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787787287.942280:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787287.942282:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07185a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694445184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787287.942297:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787787287.942302:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07185a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694444928:0@lo:400:kworker.0 00000100:00100000:0.0:1787787287.942322:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787287.942334:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07185a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694445184:12345-0@lo:400:kworker.0 Request processed in 53us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787287.942341:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1787787287.942345:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787787287.942357:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694444928 00000100:00100000:0.0:1787787287.942358:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694445056 00000100:00100000:2.0:1787787287.942361:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694444928 00000100:00100000:0.0:1787787287.942361:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694445056 00000100:00100000:2.0:1787787287.942385:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787787287.942385:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694444672 00000100:00100000:0.0:1787787287.942387:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694444672 00000100:00100000:2.0:1787787287.942391:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073475c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694444928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787287.942397:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694444800 00000100:00100000:0.0:1787787287.942399:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694444800 00000100:00100000:0.0:1787787287.942413:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787787287.942418:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07185a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874630694445056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787287.942422:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073475c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694444928:12345-0@lo:400:kworker.0 Request processed in 32us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787287.942427:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787787287.942466:0:5821:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787787287.942468:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07185a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874630694445056:12345-0@lo:400:kworker.0 Request processed in 50us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787287.942474:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787787287.942483:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787787287.942485:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787787287.942518:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07185a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1874630694445056:0@lo:400:kworker.0 00010000:00080000:2.0:1787787287.942532:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d07185a1a40 x1874630694445184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787287.942542:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07185a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694445184:0@lo:400:kworker.0 00000100:00100000:1.0:1787787287.942671:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3293:x1874630694444544:12345-0@lo:400:kworker.0 Request processed in 6128us (6332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787287.942682:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1787787287.942779:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073475c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874630694444672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787287.942868:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073475c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874630694444672:12345-0@lo:400:kworker.0 Request processed in 377us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787287.942882:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787787287.942895:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787787287.942902:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073475e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694444800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787287.942955:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073475e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694444800:12345-0@lo:400:kworker.0 Request processed in 54us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787287.942961:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1787787287.943152:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787787287.943157:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787787287.943194:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d07185a2580 x1874630694444928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787287.943206:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07185a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694444928:0@lo:400:kworker.0 00000100:00100000:0.0:1787787287.943219:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07185a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694444800:0@lo:400:kworker.0 00000100:00100000:1.0:1787787287.943732:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07185a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874630694444672:0@lo:400:kworker.0 00010000:00010000:2.0:1787787288.188698:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787288.445200:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694445312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787288.445304:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787288.445403:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694445312 00000100:00100000:1.0:1787787288.445417:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694445312 00000100:00100000:1.0:1787787288.445555:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787787288.445571:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073475cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694445312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787787288.445612:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787787288.446382:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073475cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694445312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 815us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787288.446391:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1787787288.446474:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0737e443c0 x1874630694445312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787304 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787288.446503:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694445312:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787787289.213426:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787289.468772:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787787289.468801:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07185a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694445440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787289.468895:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787289.469040:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694445440 00000100:00100000:0.0:1787787289.469049:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694445440 00000100:00080000:2.0:1787787289.469104:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787787289.469128:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787787289.469139:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07185a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694445440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787787289.469182:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787787289.469236:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07185a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694445440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787289.469244:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1787787289.469288:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d07185a03c0 x1874630694445440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787305 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787289.469321:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07185a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694445440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787289.572715:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787289.572830:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678683904 00000100:00100000:3.0:1787787289.572843:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678683904 00000100:00100000:3.0:1787787289.572936:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 200 00000100:00100000:3.0:1787787289.572947:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:2344:x1874630678683904:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787289.573041:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:2344:x1874630678683904:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 97us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787289.573049:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 200 00000100:00100000:2.0:1787787289.576388:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787289.576718:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678684032 00000100:00100000:0.0:1787787289.576735:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678684032 00000100:00080000:2.0:1787787289.576828:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787289.576853:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 52 00000100:00100000:0.0:1787787289.576878:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07185a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2344:x1874630678684032:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787787289.576989:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07185a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2344:x1874630678684032:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 125us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787289.576998:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 52 00010000:00010000:0.0:1787787290.239365:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787291.261379:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787292.285550:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787293.060685:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787787293.061031:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787787293.061052:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874630694445696:0@lo:400:kworker.0 00000100:00100000:2.0:1787787293.061115:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787293.061208:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694445696 00000100:00100000:0.0:1787787293.061215:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694445696 00000100:00100000:3.0:1787787293.061298:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694445568:0@lo:400:kworker.0 00000100:00100000:3.0:1787787293.061332:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787293.061497:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787787293.061508:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07185a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874630694445696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787293.061560:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07185a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874630694445696:12345-0@lo:400:kworker.0 Request processed in 54us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787293.061567:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787787293.061637:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874630694445696:0@lo:400:kworker.0 00000100:00100000:1.0:1787787293.061821:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694445568 00000100:00100000:1.0:1787787293.061826:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694445568 00000100:00100000:1.0:1787787293.061854:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787787293.061862:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3294:x1874630694445568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787293.061914:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3294:x1874630694445568:12345-0@lo:400:kworker.0 Request processed in 52us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787293.061921:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787787293.061949:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694445824:0@lo:400:kworker.0 00000100:00100000:1.0:1787787293.061987:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787293.062019:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694446208:0@lo:400:kworker.0 00000100:00100000:3.0:1787787293.062046:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787293.062073:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694445568:0@lo:400:kworker.0 00000100:00100000:3.0:1787787293.062085:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787787293.062091:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe01680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1874630694446080:0@lo:400:kworker.0 00000100:00100000:3.0:1787787293.062118:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694446208 00000100:00100000:3.0:1787787293.062121:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694446208 00000100:00100000:3.0:1787787293.062157:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787787293.062166:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a08780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694446208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787293.062201:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a08780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694446208:12345-0@lo:400:kworker.0 Request processed in 38us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787293.062207:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1787787293.062225:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787787293.062339:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787787293.062356:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694445952:0@lo:400:kworker.0 00000100:00100000:1.0:1787787293.062388:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787293.062511:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694445952 00000100:00100000:1.0:1787787293.062515:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694445952 00000100:00100000:1.0:1787787293.062544:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787787293.062550:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694445952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787293.062584:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694445952:12345-0@lo:400:kworker.0 Request processed in 34us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787293.062590:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1787787293.062615:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787787293.062632:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0737e46d00 x1874630694445952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787293.062642:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694445952:0@lo:400:kworker.0 00000100:00100000:1.0:1787787293.062663:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787293.062853:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694445824 00000100:00100000:2.0:1787787293.062857:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694445824 00000100:00100000:2.0:1787787293.062893:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787787293.062910:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe02d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694445824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787293.062949:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe02d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694445824:12345-0@lo:400:kworker.0 Request processed in 51us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787293.062954:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1787787293.063201:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d073fe003c0 x1874630694446208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787293.063211:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694446208:0@lo:400:kworker.0 00000100:00080000:1.0:1787787293.063228:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787787293.063244:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694445824:0@lo:400:kworker.0 00000100:00100000:2.0:1787787293.063353:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694446080 00000100:00100000:2.0:1787787293.063357:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694446080 00000100:00100000:2.0:1787787293.063398:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787787293.063404:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874630694446080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787293.063469:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874630694446080:12345-0@lo:400:kworker.0 Request processed in 65us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787293.063476:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1787787293.063645:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787787293.063664:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe01680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1874630694446080:0@lo:400:kworker.0 00010000:00010000:3.0:1787787293.308605:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787293.568140:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe01680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694446336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787787293.568211:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787293.568288:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694446336 00000100:00100000:1.0:1787787293.568295:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694446336 00000100:00100000:1.0:1787787293.568341:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787787293.568351:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694446336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787787293.568384:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787787293.568428:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694446336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (218us total) trans 0 rc 0/0 00010000:00080000:0.0:1787787293.568514:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d073fe01680 x1874630694446336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787309 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787293.568532:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe01680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694446336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787787293.569126:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1787787294.332593:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787294.590148:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07185a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694446464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787787294.590314:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787294.590424:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694446464 00000100:00100000:0.0:1787787294.590432:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694446464 00000100:00100000:0.0:1787787294.590500:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787787294.590509:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694446464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787787294.590568:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787787294.590835:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694446464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 326us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787294.590844:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1787787294.591037:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d07185a0b40 x1874630694446464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787310 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787294.591055:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07185a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694446464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787787294.690176:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787294.690238:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787294.690391:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678684160 00000100:00100000:0.0:1787787294.690400:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678684160 00000100:00100000:0.0:1787787294.690472:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 202 00000100:00100000:0.0:1787787294.690481:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:2342:x1874630678684160:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787787294.690559:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:2342:x1874630678684160:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 79us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787294.690567:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 202 00000100:00100000:2.0:1787787294.691401:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678684288 00000100:00100000:2.0:1787787294.691409:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678684288 00000100:00100000:2.0:1787787294.691496:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 56 00000100:00100000:2.0:1787787294.691505:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2342:x1874630678684288:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787787294.691571:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2342:x1874630678684288:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 68us (1332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787294.691579:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 56 00000100:00080000:1.0:1787787294.692161:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787787295.356740:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787787296.072172:0:10106:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 19:34:54 (1787787294) === 00010000:00010000:1.0:1787787296.381376:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787296.585390:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787296.585497:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678684416 00000100:00100000:3.0:1787787296.585506:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678684416 00000100:00100000:3.0:1787787296.585570:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 203 00000100:00100000:3.0:1787787296.585580:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:8131:x1874630678684416:12345-192.168.206.10@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787787296.585596:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787296.585612:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0708771c00/0xdeb1953cba4b112c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c34fbb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787296.585649:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0708771c00/0xdeb1953cba4b112c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34fbb expref: 11 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787296.585689:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0708771c00/0xdeb1953cba4b112c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34fbb expref: 11 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787296.585698:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708771c00, rc 0) 00000100:00100000:3.0:1787787296.585762:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+11:8131:x1874630678684416:12345-192.168.206.10@tcp:101:mount.lustre.0 Request processed in 183us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787296.585769:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 203 00000100:00100000:3.0:1787787296.602700:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787296.602846:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678684544 00000100:00100000:1.0:1787787296.602855:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678684544 00000100:00100000:1.0:1787787296.602919:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 204 00000100:00100000:1.0:1787787296.602930:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+11:8131:x1874630678684544:12345-192.168.206.10@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787787296.603250:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+11:8131:x1874630678684544:12345-192.168.206.10@tcp:501:mount.lustre.0 Request processed in 321us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787296.603258:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 204 00000100:00100000:2.0:1787787296.605391:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787296.605478:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678684672 00000100:00100000:0.0:1787787296.605486:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678684672 00000100:00100000:0.0:1787787296.605540:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 205 00000100:00100000:0.0:1787787296.605548:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+11:8131:x1874630678684672:12345-192.168.206.10@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787787296.605771:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+11:8131:x1874630678684672:12345-192.168.206.10@tcp:503:mount.lustre.0 Request processed in 223us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787296.605779:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 205 00000100:00100000:0.0:1787787296.611331:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787296.611490:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678684800 00000100:00100000:3.0:1787787296.611500:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678684800 00000100:00100000:3.0:1787787296.611559:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 206 00000100:00100000:3.0:1787787296.611568:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+11:8135:x1874630678684800:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787787296.614556:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+11:8135:x1874630678684800:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 2978us (3221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787296.614570:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 206 00000100:00100000:3.0:1787787296.630551:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787296.631006:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678684928 00000100:00100000:1.0:1787787296.631016:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678684928 00000100:00100000:1.0:1787787296.631071:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 207 00000100:00100000:1.0:1787787296.631081:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+11:8135:x1874630678684928:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787787296.631356:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+11:8135:x1874630678684928:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 275us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787296.631364:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 207 00000100:00100000:2.0:1787787296.641786:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787296.641940:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678685056 00000100:00100000:3.0:1787787296.641949:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678685056 00000100:00100000:3.0:1787787296.642091:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 208 00000100:00100000:3.0:1787787296.642103:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+11:8131:x1874630678685056:12345-192.168.206.10@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787787296.642117:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787296.642132:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0708770e00/0xdeb1953cba4b1133 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c34fe5 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787296.642686:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0708770e00/0xdeb1953cba4b1133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34fe5 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787296.642717:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0708770e00/0xdeb1953cba4b1133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34fe5 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787296.642726:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708770e00, rc 0) 00000100:00100000:3.0:1787787296.643725:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+12:8131:x1874630678685056:12345-192.168.206.10@tcp:101:mount.lustre.0 Request processed in 1618us (1943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787296.643736:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 208 00000100:00100000:2.0:1787787296.652057:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787296.652512:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678685184 00000100:00100000:1.0:1787787296.652587:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678685184 00000100:00100000:1.0:1787787296.652645:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 209 00000100:00100000:1.0:1787787296.652654:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+12:8131:x1874630678685184:12345-192.168.206.10@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787787296.652682:0:5813:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787787296.652705:0:5813:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787787296.652710:0:5813:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787787296.652713:0:5813:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787787296.652715:0:5813:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1787787296.656027:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+12:8131:x1874630678685184:12345-192.168.206.10@tcp:256:mount.lustre.0 Request processed in 2273us (2879us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787296.656041:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 209 00000100:00100000:2.0:1787787296.659430:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787296.659595:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678685312 00000100:00100000:3.0:1787787296.659605:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678685312 00000100:00100000:3.0:1787787296.659893:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 210 00000100:00100000:3.0:1787787296.659904:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+12:8131:x1874630678685312:12345-192.168.206.10@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787787296.659921:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787296.659937:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b113a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c34fec expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787296.660059:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b113a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34fec expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787296.660073:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b113a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34fec expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787296.660083:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708770800, rc 0) 00000100:00100000:3.0:1787787296.660182:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:8131:x1874630678685312:12345-192.168.206.10@tcp:101:mount.lustre.0 Request processed in 280us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787296.660190:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 210 00000100:00100000:2.0:1787787296.662784:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787296.663048:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678685440 00000100:00100000:1.0:1787787296.663057:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678685440 00000100:00100000:1.0:1787787296.663143:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 211 00000100:00100000:1.0:1787787296.663153:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:8131:x1874630678685440:12345-192.168.206.10@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787787296.663497:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:8131:x1874630678685440:12345-192.168.206.10@tcp:501:mount.lustre.0 Request processed in 344us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787296.663505:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 211 00000100:00100000:0.0:1787787296.670754:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787296.670853:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678685568 00000100:00100000:3.0:1787787296.670873:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678685568 00000100:00100000:3.0:1787787296.670941:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 212 00000100:00100000:3.0:1787787296.670951:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:8131:x1874630678685568:12345-192.168.206.10@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787787296.671259:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:8131:x1874630678685568:12345-192.168.206.10@tcp:503:mount.lustre.0 Request processed in 309us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787296.671277:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 212 00000100:00100000:2.0:1787787296.679077:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787296.679161:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678685696 00000100:00100000:1.0:1787787296.679170:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678685696 00000100:00100000:1.0:1787787296.679231:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 213 00000100:00100000:1.0:1787787296.679246:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:8139:x1874630678685696:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787787296.679500:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:8139:x1874630678685696:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 255us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787296.679508:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 213 00000100:00100000:2.0:1787787296.682845:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787296.682950:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678685824 00000100:00100000:3.0:1787787296.682959:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678685824 00000100:00100000:3.0:1787787296.683086:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 214 00000100:00100000:3.0:1787787296.683096:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703094050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:8139:x1874630678685824:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787787296.683578:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703094050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:8139:x1874630678685824:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 482us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787296.683587:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 214 00000100:00100000:0.0:1787787296.701058:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787296.701102:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787296.703698:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678686208 00000100:00100000:3.0:1787787296.703712:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678686208 00000100:00100000:2.0:1787787296.705412:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678685952 00000100:00100000:2.0:1787787296.705423:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678685952 00000100:00100000:2.0:1787787296.705491:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:2.0:1787787296.705500:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073475da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2341:x1874630678685952:12345-192.168.206.10@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787787296.705537:0:5819:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 267c8212-9bde-4b8e-bca1-0730dc2554b7@192.168.206.10@tcp t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:2.0:1787787296.705574:0:5819:0:(genops.c:1385:class_connect()) connect: client 267c8212-9bde-4b8e-bca1-0730dc2554b7, cookie 0xdeb1953cba4b1141 00000004:00100000:2.0:1787787296.705601:0:5819:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787787296.705867:0:5819:0:(import.c:65:import_set_state_nolock()) ffff9d0707219800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787296.705949:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073475da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267c8212-9bde-4b8e-bca1-0730dc2554b7+6:2341:x1874630678685952:12345-192.168.206.10@tcp:38:mount.lustre.0 Request processed in 448us (4846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787296.705968:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:2.0:1787787296.710752:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787296.710793:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00080000:2.0:1787787296.712558:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787296.716573:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678686336 00000100:00100000:3.0:1787787296.716588:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678686336 00000100:00100000:3.0:1787787296.716651:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678686080 00000100:00100000:3.0:1787787296.716654:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678686080 00000100:00100000:3.0:1787787296.716675:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 57 00000100:00100000:3.0:1787787296.716685:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073475e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2342:x1874630678686208:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787296.716770:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073475e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2342:x1874630678686208:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 85us (15719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787296.716777:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 57 00000100:00100000:3.0:1787787296.716794:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00080000:2.0:1787787296.716987:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787296.717020:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:3.0:1787787296.717028:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07185a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267c8212-9bde-4b8e-bca1-0730dc2554b7+7:8131:x1874630678686336:12345-192.168.206.10@tcp:41:mount.lustre.0 00000100:00100000:2.0:1787787296.717031:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07185a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267c8212-9bde-4b8e-bca1-0730dc2554b7+7:0:x1874630678686080:12345-192.168.206.10@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787787296.717063:0:5821:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000004:00000024:3.0:1787787296.717068:0:5819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787787296.717142:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07185a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267c8212-9bde-4b8e-bca1-0730dc2554b7+7:0:x1874630678686080:12345-192.168.206.10@tcp:41:mount.lustre.0 Request processed in 114us (6348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787296.717150:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:2.0:1787787296.718357:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07185a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267c8212-9bde-4b8e-bca1-0730dc2554b7+6:8131:x1874630678686336:12345-192.168.206.10@tcp:41:mount.lustre.0 Request processed in 1548us (7606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787296.718369:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:2.0:1787787296.721504:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787296.721649:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678686464 00000100:00100000:3.0:1787787296.721659:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678686464 00000100:00100000:3.0:1787787296.721747:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:3.0:1787787296.721758:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07185a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267c8212-9bde-4b8e-bca1-0730dc2554b7+6:8131:x1874630678686464:12345-192.168.206.10@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787787296.721846:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07185a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267c8212-9bde-4b8e-bca1-0730dc2554b7+6:8131:x1874630678686464:12345-192.168.206.10@tcp:40:mount.lustre.0 Request processed in 91us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787296.721854:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:1.0:1787787296.725501:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787296.725632:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787296.725661:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787296.725738:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678686592 00000100:00100000:3.0:1787787296.725747:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678686592 00000100:00100000:3.0:1787787296.725783:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678686720 00000100:00100000:3.0:1787787296.725786:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678686720 00000100:00100000:3.0:1787787296.725799:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:3.0:1787787296.725818:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe00f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2341:x1874630678686592:12345-192.168.206.10@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787787296.725845:0:6675:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 267c8212-9bde-4b8e-bca1-0730dc2554b7@192.168.206.10@tcp t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:3.0:1787787296.725876:0:6675:0:(genops.c:1385:class_connect()) connect: client 267c8212-9bde-4b8e-bca1-0730dc2554b7, cookie 0xdeb1953cba4b1148 00002000:00100000:3.0:1787787296.725897:0:6675:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 267c8212-9bde-4b8e-bca1-0730dc2554b7/ffff9d070306b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113934 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787787296.725918:0:6675:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787787296.726127:0:6675:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787787296.726154:0:6675:0:(import.c:65:import_set_state_nolock()) ffff9d070306f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787787296.726212:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe00f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:267c8212-9bde-4b8e-bca1-0730dc2554b7+6:2341:x1874630678686592:12345-192.168.206.10@tcp:8:mount.lustre.0 Request processed in 393us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787296.726221:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:3.0:1787787296.726237:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:3.0:1787787296.726242:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2341:x1874630678686720:12345-192.168.206.10@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787787296.726283:0:6675:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 267c8212-9bde-4b8e-bca1-0730dc2554b7@192.168.206.10@tcp t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:3.0:1787787296.726306:0:6675:0:(genops.c:1385:class_connect()) connect: client 267c8212-9bde-4b8e-bca1-0730dc2554b7, cookie 0xdeb1953cba4b114f 00002000:00100000:3.0:1787787296.726311:0:6675:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 267c8212-9bde-4b8e-bca1-0730dc2554b7/ffff9d070306b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113934 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787787296.726325:0:6675:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787787296.726487:0:6675:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787787296.726502:0:6675:0:(import.c:65:import_set_state_nolock()) ffff9d070306d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787787296.726713:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:267c8212-9bde-4b8e-bca1-0730dc2554b7+6:2341:x1874630678686720:12345-192.168.206.10@tcp:8:mount.lustre.0 Request processed in 282us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787296.726721:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:0.0:1787787296.728301:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678686848 00000100:00100000:0.0:1787787296.728312:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678686848 00000100:00100000:2.0:1787787296.728673:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00100000:2.0:1787787296.728684:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe01e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:267c8212-9bde-4b8e-bca1-0730dc2554b7+6:8131:x1874630678686848:12345-192.168.206.10@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787787296.728987:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787787296.729125:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe01e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:267c8212-9bde-4b8e-bca1-0730dc2554b7+6:8131:x1874630678686848:12345-192.168.206.10@tcp:33:mount.lustre.0 Request processed in 442us (3631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787296.729133:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 1 00010000:00010000:3.0:1787787297.404930:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787298.172674:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe02940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694446976:0@lo:400:kworker.0 00000100:00100000:1.0:1787787298.172741:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787298.172802:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787787298.172808:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1874630694446848:0@lo:400:kworker.0 00000100:00100000:1.0:1787787298.172835:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787298.172863:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694446976 00000100:00100000:1.0:1787787298.172870:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694446976 00000100:00100000:2.0:1787787298.172909:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe03840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874630694446720:0@lo:400:kworker.0 00000100:00100000:1.0:1787787298.172931:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787787298.172937:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787298.172938:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe01a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694446976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787298.172958:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe00b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694447232:0@lo:400:kworker.0 00000100:00100000:1.0:1787787298.172985:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe01a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694446976:12345-0@lo:400:kworker.0 Request processed in 48us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787298.172992:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787787298.173131:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe03c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694446592:0@lo:400:kworker.0 00010000:00080000:1.0:1787787298.173228:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d073fe02940 x1874630694446976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787298.173241:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe02940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694446976:0@lo:400:kworker.0 00000100:00100000:2.0:1787787298.176133:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787298.176383:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694447232 00000100:00100000:1.0:1787787298.176391:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694447232 00000100:00100000:1.0:1787787298.176589:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787787298.176600:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07185a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694447232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787298.176664:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07185a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694447232:12345-0@lo:400:kworker.0 Request processed in 67us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787298.176671:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1787787298.176735:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d073fe00b40 x1874630694447232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787298.176749:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe00b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694447232:0@lo:400:kworker.0 00000100:00100000:2.0:1787787298.176774:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694446848 00000100:00100000:2.0:1787787298.176778:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694446848 00000100:00100000:2.0:1787787298.176804:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694446720 00000100:00100000:2.0:1787787298.176807:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694446720 00000100:00100000:2.0:1787787298.176825:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787787298.176830:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe01680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1874630694446848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787298.176892:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe01680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1874630694446848:12345-0@lo:400:kworker.0 Request processed in 61us (4056us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787298.176899:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787787298.176910:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787787298.176917:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07185a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874630694446720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787298.176948:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07185a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874630694446720:12345-0@lo:400:kworker.0 Request processed in 32us (4009us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787298.176954:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1787787298.176966:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787787298.176970:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787787298.176972:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787298.176981:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1874630694446848:0@lo:400:kworker.0 00000100:00100000:3.0:1787787298.176994:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe03840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874630694446720:0@lo:400:kworker.0 00000100:00100000:0.0:1787787298.177187:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787298.177239:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe00780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1874630694447104:0@lo:400:kworker.0 00000100:00100000:0.0:1787787298.177282:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787298.177355:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694447104 00000100:00100000:2.0:1787787298.177360:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694447104 00000100:00100000:2.0:1787787298.177399:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787787298.177406:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694446592 00000100:00100000:2.0:1787787298.177406:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073475de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874630694447104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787298.177409:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694446592 00000100:00100000:3.0:1787787298.177456:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787787298.177458:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073475de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874630694447104:12345-0@lo:400:kworker.0 Request processed in 53us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787298.177463:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3293:x1874630694446592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787298.177463:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787787298.177498:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3293:x1874630694446592:12345-0@lo:400:kworker.0 Request processed in 37us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787298.177498:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe03c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694446592:0@lo:400:kworker.0 00000100:00100000:3.0:1787787298.177504:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787787298.177507:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe00780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1874630694447104:0@lo:400:kworker.0 00000100:00080000:0.0:1787787298.177565:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787787298.428567:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787298.689044:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073476b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694447360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787787298.689109:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787298.689406:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694447360 00000100:00100000:2.0:1787787298.689413:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694447360 00000100:00100000:2.0:1787787298.689472:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787787298.689482:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0734768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694447360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787787298.689511:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787298.689553:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0734768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694447360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787298.689560:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1787787298.689762:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d073476b480 x1874630694447360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787314 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787298.689782:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073476b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694447360:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1787787298.756614:0:5842:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 267c8212-9bde-4b8e-bca1-0730dc2554b7 00000001:00100000:2.0:1787787298.767594:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 267c8212-9bde-4b8e-bca1-0730dc2554b7 00010000:00010000:3.0:1787787299.456360:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787299.709592:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073476b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694447488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787787299.709662:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787299.709992:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694447488 00000100:00100000:1.0:1787787299.710000:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694447488 00000100:00100000:1.0:1787787299.710055:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787787299.710064:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073475f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694447488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787787299.710097:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787787299.711966:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073475f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694447488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1897us (2297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787299.711978:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1787787299.713581:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d073476b480 x1874630694447488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787315 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787299.713611:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073476b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694447488:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1787787300.273997:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 267c8212-9bde-4b8e-bca1-0730dc2554b7 00010000:00010000:1.0:1787787300.476869:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787787301.479867:0:10306:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1787787301.503039:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787301.862201:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787301.862240:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787301.862273:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787301.862301:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787301.862336:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787301.862499:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678687488 00000100:00100000:0.0:1787787301.862509:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678687488 00000100:00100000:3.0:1787787301.862538:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678686976 00000100:00100000:3.0:1787787301.862543:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678686976 00000100:00100000:3.0:1787787301.862575:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 216 00000100:00100000:3.0:1787787301.862584:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2345:x1874630678686976:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787787301.862623:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678687360 00000100:00100000:0.0:1787787301.862627:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678687360 00000100:00100000:0.0:1787787301.862645:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 33 00000100:00100000:3.0:1787787301.862651:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2345:x1874630678686976:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 69us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787301.862651:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe00780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2345:x1874630678687488:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787301.862658:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 216 00000100:00100000:0.0:1787787301.862678:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe00780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2345:x1874630678687488:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 27us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787301.862684:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 33 00000100:00100000:0.0:1787787301.862695:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 34 00000100:00100000:0.0:1787787301.862701:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe03840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2345:x1874630678687360:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787301.862704:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678687232 00000100:00100000:3.0:1787787301.862707:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678687232 00000100:00100000:0.0:1787787301.862722:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe03840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2345:x1874630678687360:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 22us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787301.862727:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678687104 00000100:00100000:0.0:1787787301.862728:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 34 00000100:00100000:3.0:1787787301.862730:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678687104 00000100:00100000:3.0:1787787301.862747:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 61 00000100:00100000:3.0:1787787301.862753:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe02940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2345:x1874630678687232:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787301.862794:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe02940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2345:x1874630678687232:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 41us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787301.862800:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 61 00000100:00100000:3.0:1787787301.862821:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 62 00000100:00100000:3.0:1787787301.862829:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe03c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2345:x1874630678687104:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787301.862862:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe03c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2345:x1874630678687104:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 25us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787301.862868:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 62 00000100:00080000:1.0:1787787301.862898:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787787301.862903:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787787301.862905:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787787302.524870:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787303.293095:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe00b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874630694447744:0@lo:400:kworker.0 00000100:00100000:3.0:1787787303.293159:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787303.293191:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694447872:0@lo:400:kworker.0 00000100:00100000:3.0:1787787303.293230:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694448256:0@lo:400:kworker.0 00000100:00100000:0.0:1787787303.293245:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787303.293268:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787303.293284:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787787303.293293:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694448000:0@lo:400:kworker.0 00000100:00100000:3.0:1787787303.293315:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787787303.293323:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787303.293326:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694447616:0@lo:400:kworker.0 00000100:00100000:0.0:1787787303.293365:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694447744 00000100:00100000:3.0:1787787303.293367:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787303.293373:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694447744 00000100:00100000:3.0:1787787303.293395:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe81e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1874630694448128:0@lo:400:kworker.0 00000100:00100000:0.0:1787787303.293420:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694447872 00000100:00100000:3.0:1787787303.293421:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787303.293426:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694447872 00000100:00100000:0.0:1787787303.293479:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694448128 00000100:00100000:0.0:1787787303.293483:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694448128 00000100:00100000:3.0:1787787303.293501:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694448256 00000100:00100000:0.0:1787787303.293505:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787787303.293508:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694448256 00000100:00100000:0.0:1787787303.293516:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874630694447744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787303.293544:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694448000 00000100:00100000:3.0:1787787303.293549:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694448000 00000100:00100000:3.0:1787787303.293572:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787787303.293574:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874630694447744:12345-0@lo:400:kworker.0 Request processed in 59us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787303.293584:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a08b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694448256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787303.293585:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787787303.293608:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787787303.293617:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694447872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787303.293635:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a08b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694448256:12345-0@lo:400:kworker.0 Request processed in 54us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787303.293642:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787787303.293657:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787787303.293664:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705975e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694448000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787303.293676:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694447872:12345-0@lo:400:kworker.0 Request processed in 60us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787303.293683:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787787303.293697:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787787303.293705:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874630694448128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787303.293710:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705975e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694448000:12345-0@lo:400:kworker.0 Request processed in 45us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787303.293718:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787787303.293742:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874630694448128:12345-0@lo:400:kworker.0 Request processed in 38us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787303.293748:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1787787303.293771:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787787303.293795:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787787303.293797:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787787303.293832:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d073fe80000 x1874630694448000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787303.293855:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694448000:0@lo:400:kworker.0 00000100:00100000:0.0:1787787303.293868:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694447872:0@lo:400:kworker.0 00000100:00100000:3.0:1787787303.294086:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694447616 00000100:00100000:3.0:1787787303.294091:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694447616 00000100:00100000:3.0:1787787303.294124:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787787303.294131:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3294:x1874630694447616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787303.294165:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3294:x1874630694447616:12345-0@lo:400:kworker.0 Request processed in 35us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787303.294171:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787787303.294414:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694447616:0@lo:400:kworker.0 00000100:00100000:2.0:1787787303.294427:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe81e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1874630694448128:0@lo:400:kworker.0 00000100:00100000:2.0:1787787303.294468:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe00b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874630694447744:0@lo:400:kworker.0 00010000:00080000:2.0:1787787303.294491:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d073fe80f00 x1874630694448256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787303.294502:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694448256:0@lo:400:kworker.0 00010000:00010000:3.0:1787787303.549017:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787303.808490:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694448384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787303.808565:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787303.808658:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694448384 00000100:00100000:0.0:1787787303.808664:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694448384 00000100:00100000:0.0:1787787303.808705:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787787303.808713:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705974f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694448384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787787303.808745:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787787303.808789:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705974f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694448384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787303.808797:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1787787303.808858:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d073fe830c0 x1874630694448384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787319 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787303.808875:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694448384:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787787304.574461:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787304.831479:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073476b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694448512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787787304.831549:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787304.831649:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694448512 00000100:00100000:1.0:1787787304.831657:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694448512 00000100:00100000:1.0:1787787304.833691:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787787304.833712:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705975a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694448512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787787304.833750:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787787304.834993:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705975a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694448512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1283us (3435us total) trans 0 rc 0/0 00010000:00080000:0.0:1787787304.834995:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d073476b840 x1874630694448512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787320 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787304.835011:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787787304.835025:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073476b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694448512:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787787305.596646:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787306.620617:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787306.982561:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787306.982626:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787306.982715:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678687616 00000100:00100000:3.0:1787787306.982725:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678687616 00000100:00100000:3.0:1787787306.982790:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 218 00000100:00100000:3.0:1787787306.982799:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2343:x1874630678687616:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787306.982876:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2343:x1874630678687616:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 77us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787306.982884:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 218 00000100:00100000:0.0:1787787306.983056:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787306.983083:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787306.983116:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678688128 00000100:00100000:3.0:1787787306.983120:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678688128 00000100:00100000:3.0:1787787306.983169:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 37 00000100:00100000:3.0:1787787306.983176:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705976940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2343:x1874630678688128:12345-192.168.206.10@tcp:400:kworker.0 00000100:00080000:1.0:1787787306.983184:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787787306.983217:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705976940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2343:x1874630678688128:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 36us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787306.983224:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 37 00000100:00100000:0.0:1787787306.989971:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787306.990835:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678688000 00000100:00100000:3.0:1787787306.990845:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678688000 00000100:00100000:3.0:1787787306.991067:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 38 00000100:00100000:3.0:1787787306.991091:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705974b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2343:x1874630678688000:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787306.991228:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705974b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2343:x1874630678688000:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 130us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787306.991238:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 38 00000100:00080000:0.0:1787787306.991922:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787306.993339:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678687872 00000100:00100000:2.0:1787787306.993350:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678687872 00000100:00100000:2.0:1787787306.993421:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678687744 00000100:00100000:2.0:1787787306.993424:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678687744 00000100:00080000:0.0:1787787306.993712:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787306.993727:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 66 00000100:00100000:3.0:1787787306.993741:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705976580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2343:x1874630678687872:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787306.993838:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705976580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2343:x1874630678687872:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 101us (11211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787306.993860:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 66 00000100:00100000:0.0:1787787306.993880:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 67 00000100:00100000:0.0:1787787306.994029:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705974780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2343:x1874630678687744:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787787306.994072:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705974780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2343:x1874630678687744:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 184us (10988us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787306.998274:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 67 00010000:00010000:3.0:1787787307.645177:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787308.414241:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874630694448768:0@lo:400:kworker.0 00000100:00100000:1.0:1787787308.414306:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787308.414353:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694449280:0@lo:400:kworker.0 00000100:00100000:1.0:1787787308.414377:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787308.414407:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787787308.414413:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe83840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694448640:0@lo:400:kworker.0 00000100:00100000:1.0:1787787308.414462:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787308.414484:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1874630694449152:0@lo:400:kworker.0 00000100:00100000:1.0:1787787308.414506:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787308.414531:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694448896:0@lo:400:kworker.0 00000100:00100000:1.0:1787787308.414553:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787308.414615:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787787308.414621:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694449024:0@lo:400:kworker.0 00000100:00100000:1.0:1787787308.414643:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787308.414671:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694448768 00000100:00100000:1.0:1787787308.414677:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694448768 00000100:00100000:1.0:1787787308.414709:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694449152 00000100:00100000:1.0:1787787308.414711:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694449152 00000100:00100000:1.0:1787787308.414740:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694448896 00000100:00100000:1.0:1787787308.414742:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694448896 00000100:00100000:1.0:1787787308.414755:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787787308.414762:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874630694448768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787308.414804:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874630694448768:12345-0@lo:400:kworker.0 Request processed in 42us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787308.414810:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787787308.414837:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787787308.414843:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874630694449152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787308.414878:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874630694449152:12345-0@lo:400:kworker.0 Request processed in 35us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787308.414884:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787787308.414893:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787787308.414898:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694448896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787308.414923:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694448896:12345-0@lo:400:kworker.0 Request processed in 25us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787308.414929:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787787308.414943:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694449280 00000100:00100000:1.0:1787787308.414946:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694449280 00000100:00100000:1.0:1787787308.414970:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694449024 00000100:00100000:1.0:1787787308.414972:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694449024 00000100:00100000:1.0:1787787308.414986:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787787308.414991:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe82d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694449280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787308.415130:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe82d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694449280:12345-0@lo:400:kworker.0 Request processed in 136us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787308.415136:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787787308.415148:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787787308.415161:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe81a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694449024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787308.415191:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe81a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694449024:12345-0@lo:400:kworker.0 Request processed in 30us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787308.415196:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787787308.415214:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694448640 00000100:00100000:1.0:1787787308.415217:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694448640 00000100:00100000:1.0:1787787308.415240:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787787308.415246:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3294:x1874630694448640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787308.415274:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3294:x1874630694448640:12345-0@lo:400:kworker.0 Request processed in 28us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787308.415279:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00010000:00080000:1.0:1787787308.415331:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d073fe80780 x1874630694449024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787308.415346:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694449024:0@lo:400:kworker.0 00000100:00100000:1.0:1787787308.415356:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694448896:0@lo:400:kworker.0 00000100:00100000:1.0:1787787308.415382:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe83840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694448640:0@lo:400:kworker.0 00000100:00100000:1.0:1787787308.415391:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1874630694449152:0@lo:400:kworker.0 00000100:00100000:1.0:1787787308.415400:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874630694448768:0@lo:400:kworker.0 00010000:00080000:1.0:1787787308.415409:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d073fe81680 x1874630694449280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787308.415417:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694449280:0@lo:400:kworker.0 00000100:00080000:0.0:1787787308.415669:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787787308.415673:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787787308.415676:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787787308.674845:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787308.924922:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694449408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787787308.925006:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787308.925080:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694449408 00000100:00100000:1.0:1787787308.925087:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694449408 00000100:00100000:2.0:1787787308.928253:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787787308.928267:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe82580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694449408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787787308.928306:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787308.928386:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe82580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694449408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (3380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787308.928393:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1787787308.928456:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d073fe81680 x1874630694449408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787324 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787308.928476:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694449408:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787787309.697114:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787309.952863:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073476a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694449536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787309.952930:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787309.953001:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694449536 00000100:00100000:2.0:1787787309.953009:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694449536 00000100:00100000:2.0:1787787309.953053:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787787309.953061:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073476a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694449536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787787309.953098:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787309.953144:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073476a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694449536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787309.953150:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1787787309.953205:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d073476a580 x1874630694449536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787325 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787309.953223:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073476a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694449536:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787787310.719121:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787311.740668:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787312.098182:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787312.098228:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787312.098264:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787312.098299:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787312.098331:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787312.098358:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678688512 00000100:00100000:3.0:1787787312.098366:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678688512 00000100:00100000:3.0:1787787312.098415:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678688384 00000100:00100000:3.0:1787787312.098418:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678688384 00000100:00100000:2.0:1787787312.098558:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 71 00000100:00100000:2.0:1787787312.098581:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2342:x1874630678688512:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787312.098582:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 72 00000100:00100000:3.0:1787787312.098590:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2342:x1874630678688384:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787787312.098667:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678688768 00000100:00100000:0.0:1787787312.098671:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678688768 00000100:00100000:0.0:1787787312.098702:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678688640 00000100:00100000:0.0:1787787312.098705:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678688640 00000100:00100000:0.0:1787787312.098721:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 41 00000100:00100000:0.0:1787787312.098728:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2342:x1874630678688768:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787787312.098786:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678688256 00000100:00100000:1.0:1787787312.098790:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678688256 00000100:00100000:1.0:1787787312.098825:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 220 00000100:00100000:1.0:1787787312.098832:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2342:x1874630678688256:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787312.098898:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2342:x1874630678688384:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 308us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787312.098906:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 72 00000100:00100000:3.0:1787787312.098929:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787787312.098937:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1787787312.101723:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2342:x1874630678688512:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 3147us (3485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787312.101723:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2342:x1874630678688768:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 2986us (3448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787312.101737:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 71 00000100:00100000:0.0:1787787312.101737:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 41 00000100:00100000:0.0:1787787312.101767:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 42 00000100:00100000:0.0:1787787312.101779:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073407c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2342:x1874630678688640:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787787312.101853:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073407c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2342:x1874630678688640:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 79us (3521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787312.101860:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 42 00000100:00080000:2.0:1787787312.101969:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787787312.101973:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787787312.101976:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787787312.102192:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2342:x1874630678688256:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 3358us (4017us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787312.102201:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 220 00010000:00010000:0.0:1787787312.766253:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787313.533107:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694449664:0@lo:400:kworker.0 00000100:00100000:3.0:1787787313.533182:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787313.533219:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874630694449792:0@lo:400:kworker.0 00000100:00100000:2.0:1787787313.533252:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787313.533337:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694449792 00000100:00100000:2.0:1787787313.533344:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694449792 00000100:00100000:2.0:1787787313.533384:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787787313.533392:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0734768b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874630694449792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787313.533471:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0734768b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874630694449792:12345-0@lo:400:kworker.0 Request processed in 79us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787313.533478:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787787313.533513:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874630694449792:0@lo:400:kworker.0 00000100:00100000:0.0:1787787313.534600:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694449920:0@lo:400:kworker.0 00000100:00100000:0.0:1787787313.534644:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787313.534875:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787787313.534882:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe81e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694450048:0@lo:400:kworker.0 00000100:00100000:0.0:1787787313.534910:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787313.534943:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694450048 00000100:00100000:0.0:1787787313.534948:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694450048 00000100:00100000:0.0:1787787313.534993:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787787313.535001:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705976940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694450048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787313.535044:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705976940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694450048:12345-0@lo:400:kworker.0 Request processed in 44us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787313.535051:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1787787313.535068:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787787313.535090:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d073fe81e00 x1874630694450048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787313.535101:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe81e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694450048:0@lo:400:kworker.0 00000100:00100000:0.0:1787787313.537503:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694450304:0@lo:400:kworker.0 00000100:00100000:0.0:1787787313.537561:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787313.537604:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787787313.537611:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1874630694450176:0@lo:400:kworker.0 00000100:00100000:0.0:1787787313.537636:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787313.540089:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694449664 00000100:00100000:1.0:1787787313.540104:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694449664 00000100:00100000:1.0:1787787313.540187:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787787313.540197:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703097050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3293:x1874630694449664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787313.540284:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703097050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3293:x1874630694449664:12345-0@lo:400:kworker.0 Request processed in 88us (7102us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787313.540291:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1787787313.540951:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694450304 00000100:00100000:0.0:1787787313.540959:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694450304 00000100:00100000:0.0:1787787313.541002:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787787313.541010:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705974b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694450304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787313.541056:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705974b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694450304:12345-0@lo:400:kworker.0 Request processed in 47us (3495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787313.541062:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1787787313.541083:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787787313.541109:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d073fe80000 x1874630694450304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787313.541123:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694450304:0@lo:400:kworker.0 00000100:00100000:3.0:1787787313.544288:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694449664:0@lo:400:kworker.0 00000100:00100000:2.0:1787787313.544406:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694449920 00000100:00100000:2.0:1787787313.544413:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694449920 00000100:00100000:2.0:1787787313.544573:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694450176 00000100:00100000:2.0:1787787313.544578:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694450176 00000100:00100000:2.0:1787787313.544621:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787787313.544630:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705975e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694449920:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787787313.544798:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787313.544849:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705975e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694449920:12345-0@lo:400:kworker.0 Request processed in 219us (10203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787313.544856:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787787313.544877:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787787313.544884:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705976d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874630694450176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787313.544917:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705976d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874630694450176:12345-0@lo:400:kworker.0 Request processed in 34us (7280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787313.544923:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787787313.544999:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694449920:0@lo:400:kworker.0 00000100:00100000:0.0:1787787313.545027:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1874630694450176:0@lo:400:kworker.0 00010000:00010000:2.0:1787787313.791374:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787314.051362:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694450432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787314.051426:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787314.051567:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694450432 00000100:00100000:1.0:1787787314.051574:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694450432 00000100:00100000:1.0:1787787314.051624:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787787314.051633:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07059761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694450432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787787314.051667:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787787314.051710:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07059761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694450432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787314.051716:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1787787314.052077:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d073fe83480 x1874630694450432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787330 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787314.052096:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694450432:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787787314.816810:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787315.069024:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787787315.069045:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694450560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787787315.069108:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787315.069202:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694450560 00000100:00100000:3.0:1787787315.069209:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694450560 00000100:00100000:3.0:1787787315.069269:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787787315.069278:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe82940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694450560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787787315.069317:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787787315.069364:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe82940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694450560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787315.069371:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1787787315.069433:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787787315.069575:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0737e46d00 x1874630694450560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787331 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787315.069592:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694450560:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787787315.837974:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787316.860592:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787317.218141:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787317.218191:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787317.218219:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787317.218255:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787317.218283:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787317.218309:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678689280 00000100:00100000:3.0:1787787317.218317:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678689280 00000100:00100000:3.0:1787787317.218366:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678689408 00000100:00100000:3.0:1787787317.218369:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678689408 00000100:00100000:3.0:1787787317.218392:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:3.0:1787787317.218402:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e47840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2341:x1874630678689280:12345-192.168.206.10@tcp:9:kworker.0 00000020:00000080:3.0:1787787317.218431:0:6673:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b1148 00000100:00080000:3.0:1787787317.218480:0:6673:0:(import.c:65:import_set_state_nolock()) ffff9d070306f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787787317.218514:0:6673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787787317.218843:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678689024 00000100:00100000:0.0:1787787317.218850:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678689024 00000100:00100000:0.0:1787787317.218882:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678689152 00000100:00100000:0.0:1787787317.218884:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678689152 00000100:00100000:0.0:1787787317.218907:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 76 00000100:00100000:0.0:1787787317.218914:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2345:x1874630678689024:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787787317.218989:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2345:x1874630678689024:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 75us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787317.218997:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 76 00000100:00100000:0.0:1787787317.219014:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 77 00000100:00100000:0.0:1787787317.219021:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2345:x1874630678689152:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787787317.219046:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2345:x1874630678689152:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 26us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787317.219051:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 77 00000100:00100000:1.0:1787787317.219140:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678688896 00000100:00100000:1.0:1787787317.219145:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678688896 00000100:00100000:1.0:1787787317.219183:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 222 00000100:00100000:1.0:1787787317.219191:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2345:x1874630678688896:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787787317.219219:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2345:x1874630678688896:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 30us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787317.219227:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 222 00000100:00080000:1.0:1787787317.219252:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787787317.219256:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787787317.219258:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787787317.219479:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:0.0:1787787317.219487:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e47c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2341:x1874630678689408:12345-192.168.206.10@tcp:9:kworker.0 00000020:00000080:0.0:1787787317.219503:0:6674:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b114f 00000100:00080000:0.0:1787787317.219509:0:6674:0:(import.c:65:import_set_state_nolock()) ffff9d070306d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787787317.219545:0:6674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787787317.220943:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e47840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:267c8212-9bde-4b8e-bca1-0730dc2554b7+2:2341:x1874630678689280:12345-192.168.206.10@tcp:9:kworker.0 Request processed in 2536us (2681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787317.220954:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:0.0:1787787317.221993:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e47c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:267c8212-9bde-4b8e-bca1-0730dc2554b7+2:2341:x1874630678689408:12345-192.168.206.10@tcp:9:kworker.0 Request processed in 2502us (3704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787317.222004:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 15 00010000:00010000:2.0:1787787317.222263:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787317.222331:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787787317.661357:0:11007:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787787317.893736:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787318.652648:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073476a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874630694450816:0@lo:400:kworker.0 00000100:00100000:2.0:1787787318.652677:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07347683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694451072:0@lo:400:kworker.0 00000100:00100000:3.0:1787787318.652778:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073476ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694450688:0@lo:400:kworker.0 00000100:00100000:2.0:1787787318.662484:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787318.662590:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787787318.662606:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07347692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1874630694450944:0@lo:400:kworker.0 00000100:00100000:2.0:1787787318.662662:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787318.662711:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694451072 00000100:00100000:2.0:1787787318.662719:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694451072 00000100:00100000:2.0:1787787318.662812:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787787318.662823:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0734768780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694451072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787318.662884:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0734768780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694451072:12345-0@lo:400:kworker.0 Request processed in 63us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787318.662913:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787787318.662938:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694450944 00000100:00100000:2.0:1787787318.662942:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694450944 00000100:00100000:2.0:1787787318.662971:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787787318.662978:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073476b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1874630694450944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787318.663008:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073476b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1874630694450944:12345-0@lo:400:kworker.0 Request processed in 32us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787318.663014:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787787318.663059:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07347692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1874630694450944:0@lo:400:kworker.0 00010000:00080000:2.0:1787787318.663073:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d07347683c0 x1874630694451072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787318.663085:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07347683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694451072:0@lo:400:kworker.0 00000100:00100000:1.0:1787787318.665385:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787318.666949:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073476a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694451328:0@lo:400:kworker.0 00000100:00100000:1.0:1787787318.667040:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787787318.667105:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787787318.667112:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787318.667128:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694451328 00000100:00100000:1.0:1787787318.667137:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694451328 00000100:00100000:1.0:1787787318.667200:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787787318.668089:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694450816 00000100:00100000:2.0:1787787318.668101:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694450816 00000100:00100000:2.0:1787787318.668164:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787787318.668173:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874630694450816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787318.668268:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874630694450816:12345-0@lo:400:kworker.0 Request processed in 97us (2895us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787318.668276:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787787318.668613:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694451328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787318.668671:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694451328:12345-0@lo:400:kworker.0 Request processed in 67us (1630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787318.668678:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1787787318.668702:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787787318.668770:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d073476a580 x1874630694451328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787318.668787:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073476a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694451328:0@lo:400:kworker.0 00000100:00100000:1.0:1787787318.668804:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073476a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874630694450816:0@lo:400:kworker.0 00000100:00100000:3.0:1787787318.670701:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787318.670785:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0734769680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1874630694451200:0@lo:400:kworker.0 00000100:00100000:3.0:1787787318.670848:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787318.670899:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694450688 00000100:00100000:1.0:1787787318.670907:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694450688 00000100:00100000:1.0:1787787318.670968:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787787318.670978:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3293:x1874630694450688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787318.671040:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3293:x1874630694450688:12345-0@lo:400:kworker.0 Request processed in 63us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787318.671047:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787787318.671977:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073476ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694450688:0@lo:400:kworker.0 00000100:00100000:2.0:1787787318.673204:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694451200 00000100:00100000:2.0:1787787318.673218:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694451200 00000100:00100000:2.0:1787787318.673305:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787787318.673316:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874630694451200:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787787318.673319:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787318.673626:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874630694451200:12345-0@lo:400:kworker.0 Request processed in 312us (2776us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787318.673651:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787787318.673836:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0734769680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1874630694451200:0@lo:400:kworker.0 00010000:00010000:0.0:1787787318.908621:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787319.169374:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787787319.169401:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07347683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694451456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787787319.169508:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787319.169586:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694451456 00000100:00100000:2.0:1787787319.169594:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694451456 00000100:00100000:2.0:1787787319.169651:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787787319.169659:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07347692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694451456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787787319.169705:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787319.169748:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07347692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694451456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787319.169770:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1787787319.169811:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d07347683c0 x1874630694451456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787335 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787319.169831:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07347683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694451456:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1787787319.266288:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 267c8212-9bde-4b8e-bca1-0730dc2554b7 00000020:00000080:2.0:1787787319.266300:0:7630:0:(genops.c:885:class_export_put()) final put ffff9d070306b000/267c8212-9bde-4b8e-bca1-0730dc2554b7 00000020:00000080:2.0:1787787319.266336:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d070306b000/267c8212-9bde-4b8e-bca1-0730dc2554b7 for lustre-OST0001 00000020:00000080:2.0:1787787319.266410:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d070306d000 for lustre-OST0001 00010000:00010000:2.0:1787787319.935607:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787320.192176:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07347683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694451584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787320.192264:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787320.192356:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694451584 00000100:00100000:2.0:1787787320.192366:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694451584 00000100:00100000:2.0:1787787320.192433:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787787320.192461:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0734769a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694451584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787787320.192515:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787320.192565:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0734769a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694451584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787320.192573:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1787787320.192596:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787787320.192629:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d07347683c0 x1874630694451584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787320.192651:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07347683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694451584:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1787787320.740495:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 267c8212-9bde-4b8e-bca1-0730dc2554b7 00000020:00000080:0.0:1787787320.740508:0:6697:0:(genops.c:885:class_export_put()) final put ffff9d070306b800/267c8212-9bde-4b8e-bca1-0730dc2554b7 00000020:00000080:3.0:1787787320.740662:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d070306b800/267c8212-9bde-4b8e-bca1-0730dc2554b7 for lustre-OST0000 00000020:00000080:3.0:1787787320.740839:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d070306f800 for lustre-OST0000 00010000:00010000:2.0:1787787320.956860:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787787321.069830:0:11156:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd4ada9500 20000000:00000080:3.0:1787787321.070111:0:11156:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d0707da9400 uarg=0000000000000000 20000000:01000000:3.0:1787787321.070239:0:11156:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787787321.070247:0:11156:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787787321.070253:0:11156:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787787321.071940:0:11157:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1787787321.072236:0:11156:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787787321.083777:0:11156:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787787321.083820:0:11156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d0708771800/0xdeb1953cba4b1156 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787321.083847:0:11156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d072212a600/0xdeb1953cba4b10fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34fb4 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787321.083856:0:11156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0708770200/0xdeb1953cba4b1109 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b1102 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787321.083864:0:11156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b1117 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b1110 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787321.083871:0:11156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0708770000/0xdeb1953cba4b1125 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b111e expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787321.083878:0:11156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b113a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34fec expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787321.083886:0:11156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d0708771800/0xdeb1953cba4b1156 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787321.083963:0:11156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b113a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34fec expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787321.083981:0:11156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b113a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34fec expref: 12 pid: 5814 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787321.083999:0:11156:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e44f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1874630694451712:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787787321.085039:0:11156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0708770000/0xdeb1953cba4b1125 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b111e expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787321.085055:0:11156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0708770000/0xdeb1953cba4b1125 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b111e expref: 18 pid: 5812 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787321.085069:0:11156:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e49680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1874630694451840:0@lo:104: 00000100:00100000:3.0:1787787321.085128:0:11156:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787787321.086070:0:11156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b1117 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b1110 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787321.086075:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694451840 00010000:00010000:3.0:1787787321.086093:0:11156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b1117 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b1110 expref: 18 pid: 5812 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787321.086093:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694451840 00000100:00100000:3.0:1787787321.086110:0:11156:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e48780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1874630694451968:0@lo:104: 00000100:00100000:1.0:1787787321.086175:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787787321.086186:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e4a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1500c007-b35b-4004-b231-bb5a7ec082ef+3:11156:x1874630694451840:12345-0@lo:104: 00010000:00010000:1.0:1787787321.086203:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9d0701647800/0xdeb1953cba4b111e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b1125 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787321.089008:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1787787321.089103:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787321.089119:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d0701647800/0xdeb1953cba4b111e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b1125 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787321.089142:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0701647800 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:2.0:1787787321.089148:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d0701647800/0xdeb1953cba4b111e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b1125 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787321.089160:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d0701647800/0xdeb1953cba4b111e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b1125 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787321.089168:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d0701647800/0xdeb1953cba4b111e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b1125 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787321.089174:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787787321.089240:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d0701647800/0xdeb1953cba4b111e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b1125 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787321.089246:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787321.089288:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d0701647800/0xdeb1953cba4b111e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b1125 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787321.089295:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d0701647800/0xdeb1953cba4b111e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b1125 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787321.089315:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787321.089317:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787321.089320:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787321.089343:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787787321.089368:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073476bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694452096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787321.089484:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787321.089539:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694452096 00000100:00100000:2.0:1787787321.089547:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694452096 00010000:00010000:2.0:1787787321.089583:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0708770000/0xdeb1953cba4b1125 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b111e expref: 19 pid: 5812 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787321.089616:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787787321.089626:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070873a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3294:x1874630694452096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787787321.089655:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787321.089661:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0708770000/0xdeb1953cba4b1125 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b111e expref: 19 pid: 5812 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787321.089673:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0708770000/0xdeb1953cba4b1125 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b111e expref: 19 pid: 5812 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787321.089695:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787321.089731:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070873a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3294:x1874630694452096:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787321.089739:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787787321.089833:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073476bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694452096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787787321.089918:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e4a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1500c007-b35b-4004-b231-bb5a7ec082ef+3:11156:x1874630694451840:12345-0@lo:104: Request processed in 3729us (4786us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787321.089934:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787787321.090340:0:11156:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787787321.090535:0:11156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0708770200/0xdeb1953cba4b1109 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b1102 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787321.090550:0:11156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0708770200/0xdeb1953cba4b1109 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b1102 expref: 18 pid: 5814 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787321.090580:0:11156:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07059752c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1874630694452224:0@lo:104: 00000100:00100000:0.0:1787787321.090618:0:11156:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787787321.090675:0:11156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d072212a600/0xdeb1953cba4b10fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34fb4 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787321.090685:0:11156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d072212a600/0xdeb1953cba4b10fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34fb4 expref: 12 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787321.090696:0:11156:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0705975680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1874630694452352:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787787321.090768:0:11156:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0707a78600 going to sleep for 11 seconds 00010000:00010000:0.0:1787787321.090790:0:11156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0708770000/0xdeb1953cba4b1125 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b111e expref: 18 pid: 5812 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787321.090804:0:11156:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e49680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1874630694451840:0@lo:104: 00000100:00100000:1.0:1787787321.090971:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694451968 00000100:00100000:1.0:1787787321.090977:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694451968 00000100:00100000:1.0:1787787321.091007:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694452224 00000100:00100000:1.0:1787787321.091011:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694452224 00000100:00100000:1.0:1787787321.091027:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787787321.091035:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e48f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1500c007-b35b-4004-b231-bb5a7ec082ef+4:11156:x1874630694451968:12345-0@lo:104: 00010000:00010000:1.0:1787787321.091048:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9d0700031c00/0xdeb1953cba4b1110 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b1117 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787321.091112:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787787321.091118:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e48f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1500c007-b35b-4004-b231-bb5a7ec082ef+4:11156:x1874630694451968:12345-0@lo:104: Request processed in 85us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787321.091126:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787787321.091150:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787787321.091156:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07059743c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1500c007-b35b-4004-b231-bb5a7ec082ef+3:11156:x1874630694452224:12345-0@lo:104: 00010000:00010000:1.0:1787787321.091164:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9d072212a800/0xdeb1953cba4b1102 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b1109 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787321.091192:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787787321.091196:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07059743c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1500c007-b35b-4004-b231-bb5a7ec082ef+3:11156:x1874630694452224:12345-0@lo:104: Request processed in 41us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787321.091202:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1787787321.091216:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787787321.091223:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d0700031c00/0xdeb1953cba4b1110 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b1117 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787321.091242:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0700031c00 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:1.0:1787787321.091247:0:8439:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d0700031c00/0xdeb1953cba4b1110 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b1117 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787321.091256:0:8439:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d0700031c00/0xdeb1953cba4b1110 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b1117 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787321.091263:0:8439:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d0700031c00/0xdeb1953cba4b1110 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b1117 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787321.091269:0:8439:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787787321.091295:0:8439:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d0700031c00/0xdeb1953cba4b1110 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b1117 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787321.091302:0:8439:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787321.091319:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d0700031c00/0xdeb1953cba4b1110 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b1117 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787321.091326:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d0700031c00/0xdeb1953cba4b1110 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b1117 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787321.091337:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787321.091340:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d072212a800/0xdeb1953cba4b1102 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b1109 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787321.091346:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212a800 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:1.0:1787787321.091349:0:8439:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d072212a800/0xdeb1953cba4b1102 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b1109 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787321.091365:0:8439:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d072212a800/0xdeb1953cba4b1102 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b1109 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787321.091372:0:8439:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d072212a800/0xdeb1953cba4b1102 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b1109 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787321.091377:0:8439:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787787321.091387:0:8439:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d072212a800/0xdeb1953cba4b1102 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b1109 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787321.091392:0:8439:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787321.091414:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d072212a800/0xdeb1953cba4b1102 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b1109 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787321.091421:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d072212a800/0xdeb1953cba4b1102 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b1109 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787321.091608:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787321.091612:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787321.091613:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787321.091621:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787787321.091688:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694452480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787787321.091721:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787321.091761:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694452480 00000100:00100000:1.0:1787787321.091764:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694452480 00010000:00010000:1.0:1787787321.091782:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b1117 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b1110 expref: 18 pid: 5812 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787321.091805:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787787321.091810:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe83840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1500c007-b35b-4004-b231-bb5a7ec082ef+18:3293:x1874630694452480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787787321.091826:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787321.091831:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b1117 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b1110 expref: 18 pid: 5812 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787321.091841:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b1117 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b1110 expref: 18 pid: 5812 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787321.091857:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787321.091886:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe83840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1500c007-b35b-4004-b231-bb5a7ec082ef+18:3293:x1874630694452480:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787321.091892:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787787321.091921:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694452480:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787787321.091997:0:11156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0700031a00/0xdeb1953cba4b1117 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b1110 expref: 17 pid: 5812 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787321.092008:0:11156:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e48780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1874630694451968:0@lo:104: 00000100:00100000:0.0:1787787321.092017:0:11156:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07059752c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1874630694452224:0@lo:104: 00010000:00010000:2.0:1787787321.092204:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787321.092215:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694452608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787321.092245:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787321.092905:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694452608 00000100:00100000:1.0:1787787321.092913:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694452608 00010000:00010000:1.0:1787787321.092937:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0708770200/0xdeb1953cba4b1109 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b1102 expref: 17 pid: 5814 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787321.092971:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787787321.092979:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073476bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1500c007-b35b-4004-b231-bb5a7ec082ef+17:3291:x1874630694452608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787787321.092990:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787321.092995:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0708770200/0xdeb1953cba4b1109 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b1102 expref: 17 pid: 5814 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787321.093005:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0708770200/0xdeb1953cba4b1109 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b1102 expref: 17 pid: 5814 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787321.093021:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0708770200/0xdeb1953cba4b1109 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b1102 expref: 17 pid: 5814 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787321.093048:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787321.093091:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073476bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1500c007-b35b-4004-b231-bb5a7ec082ef+16:3291:x1874630694452608:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787321.093098:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787787321.093774:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787321.095528:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678689536 00000100:00100000:3.0:1787787321.095548:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678689536 00010000:00010000:3.0:1787787321.095601:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b113a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34fec expref: 13 pid: 5814 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787321.095665:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 28 00000100:00100000:3.0:1787787321.095693:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705977840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2345:x1874630678689536:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787321.095713:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787321.095719:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b113a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34fec expref: 13 pid: 5814 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787321.095733:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b113a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34fec expref: 13 pid: 5814 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787321.095770:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787321.095843:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705977840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2345:x1874630678689536:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 151us (2072us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787321.095851:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 28 00000100:00100000:2.0:1787787321.096734:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694452608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787787321.099324:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00010000:00010000:1.0:1787787321.099634:0:11156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b113a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34fec expref: 12 pid: 5814 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787321.099657:0:11156:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e44f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1874630694451712:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787787321.099678:0:11156:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0705975680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11156:1874630694452352:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787787321.099727:0:11156:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d0708771800/0xdeb1953cba4b1156 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787321.100862:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678689664 00000100:00100000:2.0:1787787321.100877:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678689664 00010000:00010000:2.0:1787787321.100934:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d072212a600/0xdeb1953cba4b10fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34fb4 expref: 12 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787321.100981:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 29 00000100:00100000:2.0:1787787321.100992:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+12:2344:x1874630678689664:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787321.101009:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787321.101016:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d072212a600/0xdeb1953cba4b10fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34fb4 expref: 12 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787321.101030:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d072212a600/0xdeb1953cba4b10fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34fb4 expref: 12 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787321.101053:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d072212a600/0xdeb1953cba4b10fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34fb4 expref: 12 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787321.101071:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d0708771800/0xdeb1953cba4b1156 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787321.101081:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0708771800/0xdeb1953cba4b1156 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787321.101119:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d0708771800/0xdeb1953cba4b1156 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787321.101128:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d0708771800/0xdeb1953cba4b1156 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787321.101148:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d0708771800/0xdeb1953cba4b1156 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787321.101156:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d0708771800/0xdeb1953cba4b1156 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787321.101164:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708771800 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:2.0:1787787321.101169:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d0708771800/0xdeb1953cba4b1156 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787321.101178:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d0708771800/0xdeb1953cba4b1156 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787321.101198:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d0708771800/0xdeb1953cba4b1156 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787321.101208:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787321.101283:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+11:2344:x1874630678689664:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 291us (1970us total) trans 0 rc 0/0 00010000:00010000:1.0:1787787321.101286:0:11156:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d0708771800/0xdeb1953cba4b1156 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787321.101294:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 29 00010000:00010000:1.0:1787787321.101303:0:11156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d0708771800/0xdeb1953cba4b1156 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787321.101311:0:11156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0708771800/0xdeb1953cba4b1156 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787321.980658:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787787322.239580:0:5817:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787787322.239586:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d070598a000 from 7 10000000:01000000:0.0:1787787322.239590:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787787322.239630:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0700031a00/0xdeb1953cba4b115d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787322.239642:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d0700031a00/0xdeb1953cba4b115d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787322.239663:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d0700031a00/0xdeb1953cba4b115d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787322.239687:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07059770c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694452736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787787322.239766:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787322.239819:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07058a3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787787322.239911:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694452736 00000100:00100000:3.0:1787787322.239918:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694452736 00000100:00100000:3.0:1787787322.239969:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787787322.239979:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+16:5817:x1874630694452736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787787322.239991:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787322.240004:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0708771600/0xdeb1953cba4b1164 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b115d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787322.240036:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0708771600/0xdeb1953cba4b1164 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b115d expref: 17 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787322.240047:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0708771600/0xdeb1953cba4b1164 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b115d expref: 17 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787322.240055:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708771600, rc 0) 00000100:00100000:3.0:1787787322.240094:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+17:5817:x1874630694452736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787322.240114:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787787322.240157:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07059770c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694452736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787787322.240170:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d0700031a00/0xdeb1953cba4b115d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b1164 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787322.240179:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d0700031a00/0xdeb1953cba4b115d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b1164 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787322.240236:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e48b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694452864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787322.240261:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787322.240277:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0707a78cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787322.240290:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694452864 00000100:00100000:3.0:1787787322.240294:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694452864 00000100:00100000:3.0:1787787322.240314:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787787322.240320:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+17:5817:x1874630694452864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787322.240568:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+17:5817:x1874630694452864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 246us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787322.240575:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787787322.240605:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e48b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694452864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787322.240632:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e48b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694452992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787787322.240667:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787322.240688:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0707a78cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787322.240700:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694452992 00000100:00100000:3.0:1787787322.240703:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694452992 00000100:00100000:3.0:1787787322.240750:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787787322.240764:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+17:5817:x1874630694452992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787787322.240896:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+17:5817:x1874630694452992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787322.240903:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787787322.240941:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e48b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694452992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787787322.241661:0:11181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787787322.241711:0:5817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787787322.241724:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787787322.241732:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0700031a00/0xdeb1953cba4b115d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b1164 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787322.241752:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d0700031a00/0xdeb1953cba4b115d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b1164 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787322.241762:0:5817:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787787322.241764:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d0707278800 from 7 10000000:01000000:3.0:1787787322.241767:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787787322.241790:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0708771800/0xdeb1953cba4b116b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787322.241797:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d0708771800/0xdeb1953cba4b116b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787322.241806:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d0708771800/0xdeb1953cba4b116b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787322.241822:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e48b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694453120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787787322.241857:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787322.241893:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0707a78000 going to sleep for 11 seconds 00000100:00100000:3.0:1787787322.241907:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694453120 00000100:00100000:3.0:1787787322.241911:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694453120 00000100:00100000:3.0:1787787322.241937:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787787322.241944:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+17:5817:x1874630694453120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787787322.241952:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787322.241963:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b1172 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b116b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787322.241980:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b1172 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b116b expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787322.241990:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b1172 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b116b expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787322.241997:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708770800, rc 0) 00000100:00100000:3.0:1787787322.242024:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+18:5817:x1874630694453120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787322.242030:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787787322.242061:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e48b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694453120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787787322.242072:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d0708771800/0xdeb1953cba4b116b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b1172 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787322.242079:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d0708771800/0xdeb1953cba4b116b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b1172 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787322.242111:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e48b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694453248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787322.242133:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787322.242154:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0707a78000 going to sleep for 11 seconds 00000100:00100000:3.0:1787787322.242164:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694453248 00000100:00100000:3.0:1787787322.242167:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694453248 00000100:00100000:3.0:1787787322.242187:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787787322.242192:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+18:5817:x1874630694453248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787322.242366:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+18:5817:x1874630694453248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 172us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787322.242373:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787787322.242401:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e48b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694453248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787322.242425:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e48b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694453376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787787322.242478:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787322.242496:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d072b2c2180 going to sleep for 11 seconds 00000100:00100000:3.0:1787787322.242505:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694453376 00000100:00100000:3.0:1787787322.242508:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694453376 00000100:00100000:3.0:1787787322.242525:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787787322.242530:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+18:5817:x1874630694453376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787787322.242634:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+18:5817:x1874630694453376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787322.242641:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787787322.242669:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e48b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694453376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787787322.253114:0:11183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787787322.253241:0:5817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787787322.253259:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787787322.253269:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0708771800/0xdeb1953cba4b116b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b1172 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787322.253294:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d0708771800/0xdeb1953cba4b116b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b1172 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787322.253303:0:5817:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787787322.253306:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d0722109800 from 7 10000000:01000000:2.0:1787787322.253309:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787787322.253340:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d073fd39400/0xdeb1953cba4b1179 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787322.253347:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d073fd39400/0xdeb1953cba4b1179 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787322.253356:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d073fd39400/0xdeb1953cba4b1179 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787322.253378:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0734769e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694453504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787787322.253750:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787322.253794:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0706ba8540 going to sleep for 11 seconds 00000100:00100000:0.0:1787787322.253805:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694453504 00000100:00100000:0.0:1787787322.253812:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694453504 00000100:00100000:0.0:1787787322.253864:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787787322.253874:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+18:5817:x1874630694453504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787322.253890:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787322.253904:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0700031c00/0xdeb1953cba4b1180 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b1179 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787322.253927:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0700031c00/0xdeb1953cba4b1180 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b1179 expref: 19 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787322.253937:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0700031c00/0xdeb1953cba4b1180 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b1179 expref: 19 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787322.253945:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0700031c00, rc 0) 00000100:00100000:0.0:1787787322.253993:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+19:5817:x1874630694453504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787322.254001:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787787322.254572:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0734769e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694453504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787322.254588:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d073fd39400/0xdeb1953cba4b1179 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b1180 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787322.254597:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d073fd39400/0xdeb1953cba4b1179 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b1180 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787322.254647:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0734769e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694453632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787322.254677:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787322.255183:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0706ba8540 going to sleep for 11 seconds 00000100:00100000:0.0:1787787322.255238:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694453632 00000100:00100000:0.0:1787787322.255244:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694453632 00000100:00100000:0.0:1787787322.255281:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787787322.255288:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703093050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:5817:x1874630694453632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787322.255775:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703093050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:5817:x1874630694453632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 486us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787322.255782:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787787322.255857:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0734769e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694453632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787322.255892:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e48b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694453760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787787322.256187:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787322.256247:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d072b2c2300 going to sleep for 11 seconds 00000100:00100000:0.0:1787787322.256278:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694453760 00000100:00100000:0.0:1787787322.256282:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694453760 00000100:00100000:0.0:1787787322.256338:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787787322.256346:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+19:5817:x1874630694453760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787787322.256557:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+19:5817:x1874630694453760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 211us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787322.256563:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787787322.256635:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e48b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694453760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787787322.258334:0:11184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787787322.258398:0:5817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787787322.258417:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787787322.258427:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d073fd39400/0xdeb1953cba4b1179 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b1180 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787322.258460:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d073fd39400/0xdeb1953cba4b1179 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b1180 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787322.344659:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787322.344698:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787322.344723:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787322.344760:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678690048 00000100:00100000:2.0:1787787322.344769:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678690048 00000100:00100000:2.0:1787787322.344825:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678689920 00000100:00100000:2.0:1787787322.344828:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678689920 00000100:00100000:2.0:1787787322.344851:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 81 00000100:00100000:2.0:1787787322.344860:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0734768f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2345:x1874630678690048:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787787322.344931:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0734768f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2345:x1874630678690048:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 71us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787322.344939:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 81 00000100:00100000:2.0:1787787322.344954:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 82 00000100:00100000:2.0:1787787322.344961:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073476b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2345:x1874630678689920:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787787322.344985:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073476b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2345:x1874630678689920:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 25us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787322.344991:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 82 00000100:00080000:2.0:1787787322.345011:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787322.345239:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678689792 00000100:00100000:3.0:1787787322.345251:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678689792 00000100:00100000:3.0:1787787322.345286:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 233 00000100:00100000:3.0:1787787322.345294:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+11:2345:x1874630678689792:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787322.345328:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+11:2345:x1874630678689792:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 36us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787322.345334:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 233 00000100:00100000:2.0:1787787322.402653:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787322.403349:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678690176 00000100:00100000:0.0:1787787322.403365:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678690176 00000100:00100000:0.0:1787787322.403486:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 234 00000100:00100000:0.0:1787787322.403498:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+11:5584:x1874630678690176:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787322.403520:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787322.403544:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0700030e00/0xdeb1953cba4b1187 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35016 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787322.403600:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0700030e00/0xdeb1953cba4b1187 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35016 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787322.403624:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0700030e00/0xdeb1953cba4b1187 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35016 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787322.403636:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0700030e00, rc 0) 00000100:00100000:0.0:1787787322.403709:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+12:5584:x1874630678690176:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 Request processed in 214us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787322.403718:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 234 00000100:00100000:2.0:1787787322.425326:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787322.425983:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678690304 00000100:00100000:3.0:1787787322.425998:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678690304 00000100:00100000:3.0:1787787322.426067:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 235 00000100:00100000:3.0:1787787322.426079:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703092050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+12:5584:x1874630678690304:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787322.426798:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703092050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+12:5584:x1874630678690304:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 Request processed in 715us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787322.426810:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 235 00000100:00100000:2.0:1787787322.438818:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787322.438910:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678690432 00000100:00100000:0.0:1787787322.438924:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678690432 00000100:00100000:0.0:1787787322.438994:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 236 00000100:00100000:0.0:1787787322.439006:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+12:5584:x1874630678690432:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787787322.439308:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+12:5584:x1874630678690432:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 Request processed in 304us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787322.439318:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 236 00000100:00100000:3.0:1787787322.457790:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787322.457975:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678690560 00000100:00100000:0.0:1787787322.457988:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678690560 00000100:00100000:0.0:1787787322.458059:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 237 00000100:00100000:0.0:1787787322.458072:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703090850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+12:5584:x1874630678690560:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787322.458096:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787322.458122:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0700030200/0xdeb1953cba4b118e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3501d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787322.458159:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0700030200/0xdeb1953cba4b118e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3501d expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787322.458173:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0700030200/0xdeb1953cba4b118e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3501d expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787322.458199:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0700030200, rc 0) 00000100:00100000:0.0:1787787322.458271:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703090850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:5584:x1874630678690560:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 Request processed in 201us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787322.458290:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 237 00000100:00100000:3.0:1787787322.462868:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787322.462917:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678690688 00000100:00100000:3.0:1787787322.462929:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678690688 00000100:00100000:3.0:1787787322.462992:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 238 00000100:00100000:3.0:1787787322.463003:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:5584:x1874630678690688:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787322.464768:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:5584:x1874630678690688:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 Request processed in 1754us (1901us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787322.464784:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 238 00000100:00100000:3.0:1787787322.478029:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787322.484211:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678690816 00000100:00100000:1.0:1787787322.484239:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678690816 00000100:00100000:1.0:1787787322.484303:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 239 00000100:00100000:1.0:1787787322.484314:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:5584:x1874630678690816:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787322.484637:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:5584:x1874630678690816:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 Request processed in 324us (6622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787322.484645:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 239 00010000:00010000:1.0:1787787323.008035:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787323.776996:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e48b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694453888:0@lo:400:kworker.0 00000100:00100000:3.0:1787787323.777075:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787323.777134:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1874630694454400:0@lo:400:kworker.0 00000100:00100000:3.0:1787787323.777162:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787323.777190:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787787323.777196:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694454272:0@lo:400:kworker.0 00000100:00100000:3.0:1787787323.777221:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787323.777257:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874630694454016:0@lo:400:kworker.0 00000100:00100000:3.0:1787787323.777281:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787323.777300:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694454528:0@lo:400:kworker.0 00000100:00100000:3.0:1787787323.777320:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787323.777337:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787787323.777342:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e49680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1874630694454144:0@lo:400:kworker.0 00000100:00100000:3.0:1787787323.777363:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787323.777394:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694453888 00000100:00100000:3.0:1787787323.777401:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694453888 00000100:00100000:3.0:1787787323.777586:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787787323.777596:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703090050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3292:x1874630694453888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787323.777650:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703090050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3292:x1874630694453888:12345-0@lo:400:kworker.0 Request processed in 56us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787323.777657:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787787323.777694:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694454400 00000100:00100000:3.0:1787787323.777698:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694454400 00000100:00100000:3.0:1787787323.777744:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694454016 00000100:00100000:3.0:1787787323.777747:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694454016 00000100:00100000:3.0:1787787323.777761:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694454144 00000100:00100000:3.0:1787787323.777763:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694454144 00000100:00100000:3.0:1787787323.777782:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787787323.777788:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1874630694454400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787323.777829:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1874630694454400:12345-0@lo:400:kworker.0 Request processed in 42us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787323.777835:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787787323.777849:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787787323.777854:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b121e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874630694454016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787323.777883:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b121e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874630694454016:12345-0@lo:400:kworker.0 Request processed in 28us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787323.777888:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787787323.777900:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787787323.777906:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b123c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874630694454144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787323.777931:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b123c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874630694454144:12345-0@lo:400:kworker.0 Request processed in 26us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787323.777937:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787787323.777954:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694454272 00000100:00100000:3.0:1787787323.777957:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694454272 00000100:00100000:3.0:1787787323.778073:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694454528 00000100:00100000:3.0:1787787323.778087:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694454528 00000100:00100000:3.0:1787787323.778115:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787787323.778122:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b123840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694454272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787323.778156:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b123840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694454272:12345-0@lo:400:kworker.0 Request processed in 34us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787323.778162:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787787323.778174:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787787323.778180:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b120b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694454528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787323.778206:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b120b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694454528:12345-0@lo:400:kworker.0 Request processed in 27us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787323.778222:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1787787323.778254:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787787323.778257:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787787323.778260:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787323.778296:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e49680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1874630694454144:0@lo:400:kworker.0 00000100:00100000:3.0:1787787323.778307:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874630694454016:0@lo:400:kworker.0 00010000:00080000:3.0:1787787323.778317:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d071b1dd2c0 x1874630694454528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787323.778327:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694454528:0@lo:400:kworker.0 00010000:00080000:3.0:1787787323.778360:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d071b1dc780 x1874630694454272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787323.778368:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694454272:0@lo:400:kworker.0 00000100:00100000:3.0:1787787323.778379:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e48b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694453888:0@lo:400:kworker.0 00000100:00100000:3.0:1787787323.778388:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1874630694454400:0@lo:400:kworker.0 00010000:00010000:1.0:1787787324.038537:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787324.293024:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07347683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694454656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787787324.293096:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787324.294083:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694454656 00000100:00100000:0.0:1787787324.294094:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694454656 00000100:00100000:0.0:1787787324.294140:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787787324.294149:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b120f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694454656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787787324.294180:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787787324.294236:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b120f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694454656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787324.294243:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1787787324.294320:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d07347683c0 x1874630694454656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787340 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787324.294340:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07347683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694454656:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1787787325.034353:0:11355:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787787325.052603:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787325.308559:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787787325.308582:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694454784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787787325.308647:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787325.308792:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694454784 00000100:00100000:3.0:1787787325.308799:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694454784 00000100:00100000:3.0:1787787325.308854:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787787325.308863:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694454784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787787325.308896:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787787325.308938:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694454784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787325.308945:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1787787325.308969:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787787325.308993:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d071b1dd680 x1874630694454784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787341 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787325.309010:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694454784:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787787326.076744:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787327.104333:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787327.461070:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787327.461117:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787327.461153:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787327.461239:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678690944 00000100:00100000:1.0:1787787327.461251:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678690944 00000100:00100000:1.0:1787787327.461318:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 241 00000100:00100000:1.0:1787787327.461329:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2344:x1874630678690944:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787787327.461422:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2344:x1874630678690944:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 95us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787327.461432:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 241 00000100:00100000:0.0:1787787327.462177:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678691200 00000100:00100000:0.0:1787787327.462187:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678691200 00000100:00100000:0.0:1787787327.462253:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678691072 00000100:00100000:0.0:1787787327.462257:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678691072 00000100:00100000:0.0:1787787327.462283:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 86 00000100:00100000:0.0:1787787327.462292:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2344:x1874630678691200:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787787327.462351:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2344:x1874630678691200:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 60us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787327.462358:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 86 00000100:00100000:0.0:1787787327.462395:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 87 00000100:00100000:0.0:1787787327.462401:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2344:x1874630678691072:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787787327.462431:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2344:x1874630678691072:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 30us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787327.462458:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 87 00000100:00080000:3.0:1787787327.462699:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787787328.132614:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787787328.540947:0:11455:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 19:35:27 (1787787327) === 00000100:00100000:3.0:1787787328.675913:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787328.675963:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787328.676084:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678691328 00000100:00100000:0.0:1787787328.676102:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678691328 00000100:00100000:0.0:1787787328.676170:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:0.0:1787787328.676180:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2345:x1874630678691328:12345-192.168.206.10@tcp:41:mkdir.0 00000004:00000024:0.0:1787787328.676223:0:5820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787787328.676321:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2345:x1874630678691328:12345-192.168.206.10@tcp:41:mkdir.0 Request processed in 142us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787328.676335:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:1.0:1787787328.676485:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678691456 00000100:00100000:1.0:1787787328.676490:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678691456 00000100:00100000:1.0:1787787328.676517:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:1.0:1787787328.676524:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:9684:x1874630678691456:12345-192.168.206.10@tcp:700:mkdir.0 00000100:00100000:1.0:1787787328.676557:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:9684:x1874630678691456:12345-192.168.206.10@tcp:700:mkdir.0 Request processed in 34us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787328.676563:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:3.0:1787787328.679229:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787328.679302:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678691712 00000100:00100000:1.0:1787787328.679311:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678691712 00000100:00100000:1.0:1787787328.679360:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:1.0:1787787328.679369:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073c76d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:9684:x1874630678691712:12345-192.168.206.10@tcp:36:mkdir.0 00010000:00010000:1.0:1787787328.679422:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787328.679509:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1076 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34f9f expref: 6 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787328.679526:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d071b71df00) 00010000:00010000:1.0:1787787328.679557:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787787328.679831:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b1195 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787328.679843:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b1195 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787328.679852:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b1195 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787328.679874:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212bc00/0xdeb1953cba4b119c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787328.679881:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212bc00/0xdeb1953cba4b119c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787328.679887:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212bc00/0xdeb1953cba4b119c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787328.683174:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787787328.683192:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b1195 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787328.683202:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b1195 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787328.683209:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b1195 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787328.683221:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212a600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787328.683225:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b1195 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787328.683233:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b1195 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787328.683249:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d07114ac800) 00010000:00010000:1.0:1787787328.683252:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787328.683256:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b1195 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787328.683263:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b1195 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787787328.683282:0:5819:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009562cbbc reply state 00000000dd114f89 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212bc00/0xdeb1953cba4b119c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787328.683290:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787787328.683611:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073c76d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+7:9684:x1874630678691712:12345-192.168.206.10@tcp:36:mkdir.0 Request processed in 4237us (4385us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787787328.683620:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 15 00010000:00010000:0.0:1787787328.701468:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212bc00/0xdeb1953cba4b119c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.701486:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212bc00/0xdeb1953cba4b119c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.701494:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212bc00/0xdeb1953cba4b119c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.701501:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212bc00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787328.701505:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212bc00/0xdeb1953cba4b119c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.701513:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212bc00/0xdeb1953cba4b119c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.701734:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d07114acf00) 00010000:00010000:0.0:1787787328.701738:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787328.701743:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212bc00/0xdeb1953cba4b119c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.701751:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212bc00/0xdeb1953cba4b119c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787328.707427:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787328.707795:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678691840 00000100:00100000:1.0:1787787328.707805:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678691840 00000100:00100000:1.0:1787787328.707858:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:1.0:1787787328.707868:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+6:9685:x1874630678691840:12345-192.168.206.10@tcp:101:chmod.0 00010000:00010000:1.0:1787787328.707888:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787328.707909:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b11a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35024 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787328.707982:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ac00/0xdeb1953cba4b11aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787328.707996:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ac00/0xdeb1953cba4b11aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787328.708006:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ac00/0xdeb1953cba4b11aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787328.708069:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787787328.708073:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787787328.708113:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ac00/0xdeb1953cba4b11aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787328.708137:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b11a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35024 expref: 8 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787328.708153:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ac00/0xdeb1953cba4b11aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35024 expref: 7 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787328.708166:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d07114ac800) 00010000:00010000:1.0:1787787328.708168:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787787328.708171:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d072212ac00, rc 0) 00000100:00100000:1.0:1787787328.708232:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+7:9685:x1874630678691840:12345-192.168.206.10@tcp:101:chmod.0 Request processed in 365us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787328.708239:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:0.0:1787787328.718760:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787328.718912:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678692096 00000100:00100000:3.0:1787787328.718922:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678692096 00000100:00100000:3.0:1787787328.718974:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 17 00000100:00100000:3.0:1787787328.718983:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705977c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+7:9685:x1874630678692096:12345-192.168.206.10@tcp:36:chmod.0 00010000:00010000:3.0:1787787328.719031:0:9687:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787328.719057:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ac00/0xdeb1953cba4b11aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35024 expref: 7 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.719073:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d07114ac800) 00010000:00010000:3.0:1787787328.719087:0:9687:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787787328.719111:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b11b1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.719124:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b11b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.719134:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b11b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787787328.719404:0:9687:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000362a511c reply state 00000000fe9d1c1f transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b11b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787328.719414:0:9687:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787787328.719427:0:9687:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787787328.719531:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705977c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+8:9685:x1874630678692096:12345-192.168.206.10@tcp:36:chmod.0 Request processed in 547us (775us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787787328.719538:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 17 00010000:00010000:2.0:1787787328.724364:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b11b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.724394:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b11b1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.724401:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b11b1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.724407:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708771e00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787328.724411:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b11b1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.724419:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b11b1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.724582:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d071b71d100) 00010000:00010000:2.0:1787787328.724586:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787787328.724591:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b11b1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.724597:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b11b1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787328.746841:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787328.746877:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678692224 00000100:00100000:3.0:1787787328.746885:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678692224 00000100:00100000:3.0:1787787328.746933:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 18 00000100:00100000:3.0:1787787328.746984:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073c76c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+7:9686:x1874630678692224:12345-192.168.206.10@tcp:101:chown.0 00010000:00010000:3.0:1787787328.747005:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787328.747024:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b11b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3502b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.747084:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771200/0xdeb1953cba4b11bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.747098:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771200/0xdeb1953cba4b11bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.747131:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771200/0xdeb1953cba4b11bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787328.747188:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787787328.747192:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787787328.747233:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771200/0xdeb1953cba4b11bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.747257:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b11b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3502b expref: 9 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.747270:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771200/0xdeb1953cba4b11bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3502b expref: 8 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.747279:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d071b71d900) 00010000:00010000:3.0:1787787328.747282:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787787328.747284:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708771200, rc 0) 00000100:00100000:3.0:1787787328.747333:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073c76c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+8:9686:x1874630678692224:12345-192.168.206.10@tcp:101:chown.0 Request processed in 392us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787328.747340:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 18 00000100:00100000:3.0:1787787328.753182:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787328.753301:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678692352 00000100:00100000:2.0:1787787328.753316:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678692352 00000100:00100000:2.0:1787787328.753386:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 19 00000100:00100000:2.0:1787787328.753397:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073c76ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+8:9686:x1874630678692352:12345-192.168.206.10@tcp:101:chown.0 00010000:00010000:2.0:1787787328.753416:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787328.753433:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b11c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35032 expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.753520:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b11cd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.753542:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b11cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.753554:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b11cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.753568:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b11d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.753574:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b11d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.753580:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b11d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.753672:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b11db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.753680:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b11db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.753686:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b11db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787328.753734:0:9687:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787787328.753737:0:9687:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787787328.753762:0:9687:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b11db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.753773:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b11cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.753788:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b11cd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.753795:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b11cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.753801:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd38c00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787328.753805:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b11cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.753812:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b11cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.753824:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d071b71d900) 00010000:00010000:2.0:1787787328.753826:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787328.753830:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b11cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.753836:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b11cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.753847:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b11d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.753852:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b11d4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.753857:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b11d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.753861:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd38600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787328.754973:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b11d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.754985:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b11d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.754997:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d07078d0500) 00010000:00010000:2.0:1787787328.755009:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787328.755014:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b11d4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.755022:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b11d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.755074:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b11c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35032 expref: 10 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.755088:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b11db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35032 expref: 9 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.755095:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d07078d0000) 00010000:00010000:2.0:1787787328.755097:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787787328.755100:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd38400, rc 0) 00000100:00100000:2.0:1787787328.755162:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073c76ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+9:9686:x1874630678692352:12345-192.168.206.10@tcp:101:chown.0 Request processed in 1766us (2071us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787328.755170:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 19 00000100:00100000:2.0:1787787328.764220:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787328.764256:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678692608 00000100:00100000:2.0:1787787328.764264:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678692608 00000100:00100000:2.0:1787787328.764313:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 20 00000100:00100000:2.0:1787787328.764331:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073476ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+9:9686:x1874630678692608:12345-192.168.206.10@tcp:36:chown.0 00010000:00010000:2.0:1787787328.764381:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787328.764406:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b11db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35032 expref: 9 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.764422:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d07078d0000) 00010000:00010000:2.0:1787787328.764431:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787787328.764474:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b11e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.764487:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b11e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.764497:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b11e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787787328.798358:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:3.0:1787787328.798373:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1787787328.798956:0:5820:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000415fdfc8 reply state 00000000a572e207 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b11e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787328.798969:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787787328.799181:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:2.0:1787787328.799433:0:5820:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1787787328.799477:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073476ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+7:9686:x1874630678692608:12345-192.168.206.10@tcp:36:chown.0 Request processed in 35143us (35258us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787787328.799486:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 20 00010000:00010000:0.0:1787787328.799573:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b11e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.799583:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b11e2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.799591:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b11e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.799597:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd38a00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787328.799601:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b11e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.799608:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b11e2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.799624:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d07078d0200) 00010000:00010000:0.0:1787787328.799626:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787787328.799631:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b11e2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.799647:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b11e2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787328.822276:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787328.822501:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678692736 00000100:00100000:3.0:1787787328.822516:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678692736 00000100:00100000:3.0:1787787328.822590:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 21 00000100:00100000:3.0:1787787328.822601:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073476a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:9687:x1874630678692736:12345-192.168.206.10@tcp:101:touch.500 00010000:00010000:3.0:1787787328.822633:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787328.822679:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b11e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35039 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787787328.823700:0:5819:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 943us 00010000:00010000:3.0:1787787328.841281:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771400/0xdeb1953cba4b11f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.841312:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771400/0xdeb1953cba4b11f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.841325:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771400/0xdeb1953cba4b11f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.841353:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b11f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.841362:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b11f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.841369:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b11f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.842116:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b11fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.842130:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b11fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.842140:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b11fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787328.842269:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787787328.842274:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787787328.842470:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b11fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.842494:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771400/0xdeb1953cba4b11f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.842502:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771400/0xdeb1953cba4b11f0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.842509:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771400/0xdeb1953cba4b11f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.842515:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708771400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787328.842520:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771400/0xdeb1953cba4b11f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.842528:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771400/0xdeb1953cba4b11f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.842542:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d071b71d900) 00010000:00010000:3.0:1787787328.842545:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787328.842550:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771400/0xdeb1953cba4b11f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.842556:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771400/0xdeb1953cba4b11f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.842567:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b11f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.842572:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b11f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.842577:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b11f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.842587:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708771e00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787328.842590:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b11f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.842595:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b11f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.842603:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d071b71d200) 00010000:00010000:3.0:1787787328.842605:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787328.842608:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b11f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.842613:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b11f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.842656:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b11e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35039 expref: 8 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.842672:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b11fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35039 expref: 7 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.842679:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d071b71de00) 00010000:00010000:3.0:1787787328.842681:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787787328.842684:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708770600, rc 0) 00000100:00100000:3.0:1787787328.842796:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073476a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+7:9687:x1874630678692736:12345-192.168.206.10@tcp:101:touch.500 Request processed in 20195us (20527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787328.842807:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 21 00000100:00100000:3.0:1787787328.846812:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787328.847371:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678692992 00000100:00100000:2.0:1787787328.847382:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678692992 00000100:00100000:2.0:1787787328.847464:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 22 00000100:00100000:2.0:1787787328.847475:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073c76e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+7:9687:x1874630678692992:12345-192.168.206.10@tcp:101:touch.500 00010000:00010000:2.0:1787787328.847502:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787328.847521:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1205 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35040 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.847826:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b120c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.847846:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b120c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.847858:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b120c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.847894:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b1213 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.847902:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b1213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.847908:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b1213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787787328.848738:0:5821:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1787787328.849000:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39a00/0xdeb1953cba4b121a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.849012:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39a00/0xdeb1953cba4b121a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.849022:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39a00/0xdeb1953cba4b121a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.849065:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b120c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.849072:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b120c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.849079:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b120c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.849085:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd38600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787328.849089:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b120c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.849096:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b120c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.849108:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d071b71de00) 00010000:00010000:2.0:1787787328.849111:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787328.849115:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b120c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.849121:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b120c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787787328.849133:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ade4c666 reply state 000000002ebfd84c transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b1213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787328.849142:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787787328.849170:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1205 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35040 expref: 10 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.849196:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39a00/0xdeb1953cba4b121a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35040 expref: 9 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.849203:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d07078d0a00) 00010000:00010000:2.0:1787787328.849206:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787787328.849208:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd39a00, rc 0) 00000100:00100000:2.0:1787787328.849268:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073c76e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+10:9687:x1874630678692992:12345-192.168.206.10@tcp:101:touch.500 Request processed in 1794us (2464us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787787328.849276:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 22 00010000:00010000:0.0:1787787328.851942:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b1213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.851958:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b1213 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.851965:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b1213 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.851971:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd38c00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787328.851976:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b1213 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.851983:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b1213 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.852000:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x8b258fbb (ffff9d07078d0000) 00010000:00010000:0.0:1787787328.852003:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787328.852008:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b1213 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.852013:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b1213 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787328.855848:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787328.855923:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678693248 00000100:00100000:2.0:1787787328.855933:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678693248 00000100:00100000:2.0:1787787328.855986:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 23 00000100:00100000:2.0:1787787328.855996:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073c76d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+9:9687:x1874630678693248:12345-192.168.206.10@tcp:36:touch.500 00010000:00010000:2.0:1787787328.856048:0:9687:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787328.856072:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39a00/0xdeb1953cba4b121a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35040 expref: 9 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.856090:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d07078d0a00) 00010000:00010000:2.0:1787787328.856101:0:9687:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787787328.856140:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1228 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.856153:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1228 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.856163:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1228 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787787328.856310:0:9687:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000efd2da8f reply state 000000003278cc6a transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1228 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787328.856319:0:9687:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787787328.856406:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073c76d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+10:9687:x1874630678693248:12345-192.168.206.10@tcp:36:touch.500 Request processed in 410us (565us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787787328.856413:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 23 00010000:00010000:0.0:1787787328.858639:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1228 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.858655:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1228 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.858673:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1228 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.858679:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787328.858684:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1228 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.858692:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1228 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.858716:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d07078d0500) 00010000:00010000:0.0:1787787328.858719:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787328.858723:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1228 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.858728:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1228 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787328.859363:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787328.859430:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678693376 00000100:00100000:2.0:1787787328.859504:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678693376 00000100:00100000:2.0:1787787328.859580:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 24 00000100:00100000:2.0:1787787328.859590:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073c76f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+9:9687:x1874630678693376:12345-192.168.206.10@tcp:101:touch.500 00010000:00010000:2.0:1787787328.859610:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787328.859627:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b122f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35047 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.859680:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b122f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35047 expref: 10 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.859693:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b122f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35047 expref: 10 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787328.859720:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d07078d0400) 00010000:00010000:2.0:1787787328.859723:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787787328.859726:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd39200, rc 0) 00000100:00100000:2.0:1787787328.859829:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073c76f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+10:9687:x1874630678693376:12345-192.168.206.10@tcp:101:touch.500 Request processed in 240us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787328.859836:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 24 00000100:00100000:3.0:1787787328.864075:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787328.864158:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678693504 00000100:00100000:2.0:1787787328.864167:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678693504 00000100:00100000:2.0:1787787328.864209:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:2.0:1787787328.864217:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073c76c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2341:x1874630678693504:12345-192.168.206.10@tcp:8:touch.500 00010000:00080000:2.0:1787787328.864248:0:6673:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c5599457-aa74-4a71-951f-faabe33e6ec7@192.168.206.10@tcp t0 exp 0000000000000000 cur 241 last 0 00000020:00000080:2.0:1787787328.864276:0:6673:0:(genops.c:1385:class_connect()) connect: client c5599457-aa74-4a71-951f-faabe33e6ec7, cookie 0xdeb1953cba4b1236 00002000:00100000:2.0:1787787328.864287:0:6673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c5599457-aa74-4a71-951f-faabe33e6ec7/ffff9d0707218000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113934 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787787328.864308:0:6673:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787787328.864558:0:6673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787787328.864586:0:6673:0:(import.c:65:import_set_state_nolock()) ffff9d073762e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787328.864650:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073c76c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2341:x1874630678693504:12345-192.168.206.10@tcp:8:touch.500 Request processed in 431us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787328.864657:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:1.0:1787787328.866510:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787328.866665:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678693632 00000100:00100000:3.0:1787787328.866674:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678693632 00000100:00080000:0.0:1787787328.866808:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787787328.867042:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 17 00000100:00100000:3.0:1787787328.867053:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe82d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+6:0:x1874630678693632:12345-192.168.206.10@tcp:2:touch.500 00000100:00100000:0.0:1787787328.893117:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0722250780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694455296:0@lo:400:kworker.0 00000100:00100000:0.0:1787787328.893177:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787328.893247:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787787328.893253:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07059770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694454912:0@lo:400:kworker.0 00000100:00100000:0.0:1787787328.893281:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787328.893304:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0722250b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1874630694455424:0@lo:400:kworker.0 00000100:00100000:0.0:1787787328.893326:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787328.893532:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07059752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1874630694455168:0@lo:400:kworker.0 00000100:00100000:0.0:1787787328.893561:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787328.893593:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787787328.893598:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0705975680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874630694455040:0@lo:400:kworker.0 00000100:00100000:0.0:1787787328.893620:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787328.893636:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07222a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694455552:0@lo:400:kworker.0 00000100:00100000:0.0:1787787328.893656:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787328.893683:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694454912 00000100:00100000:0.0:1787787328.893690:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694454912 00000100:00100000:0.0:1787787328.893740:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787787328.893748:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3291:x1874630694454912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787328.893792:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3291:x1874630694454912:12345-0@lo:400:kworker.0 Request processed in 44us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787328.893799:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787787328.893826:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694455424 00000100:00100000:0.0:1787787328.893830:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694455424 00000100:00100000:0.0:1787787328.893856:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694455168 00000100:00100000:0.0:1787787328.893859:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694455168 00000100:00100000:0.0:1787787328.893871:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694455040 00000100:00100000:0.0:1787787328.893874:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694455040 00000100:00100000:0.0:1787787328.893885:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787787328.893890:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07222a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1874630694455424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787328.893919:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07222a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1874630694455424:12345-0@lo:400:kworker.0 Request processed in 29us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787328.893926:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787787328.893936:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787787328.893942:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1874630694455168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787328.893968:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1874630694455168:12345-0@lo:400:kworker.0 Request processed in 27us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787328.893984:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787787328.893997:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787787328.894002:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874630694455040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787328.894030:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874630694455040:12345-0@lo:400:kworker.0 Request processed in 27us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787328.894035:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787787328.894057:0:10776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694455296 00000100:00100000:0.0:1787787328.894061:0:10776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694455296 00000100:00100000:0.0:1787787328.894083:0:10776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694455552 00000100:00100000:0.0:1787787328.894086:0:10776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694455552 00000100:00100000:0.0:1787787328.894101:0:10776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787787328.894107:0:10776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07222a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694455296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787328.894136:0:10776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07222a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694455296:12345-0@lo:400:kworker.0 Request processed in 29us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787328.894142:0:10776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787787328.894152:0:10776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787787328.894157:0:10776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694455552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787328.894293:0:10776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694455552:12345-0@lo:400:kworker.0 Request processed in 23us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787328.894303:0:10776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787787328.894341:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07059770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694454912:0@lo:400:kworker.0 00000100:00100000:0.0:1787787328.894514:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0722250b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1874630694455424:0@lo:400:kworker.0 00010000:00080000:0.0:1787787328.894526:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0722250780 x1874630694455296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787328.894538:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0722250780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694455296:0@lo:400:kworker.0 00000100:00080000:0.0:1787787328.894569:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787787328.894572:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787787328.894575:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787328.894597:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0705975680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874630694455040:0@lo:400:kworker.0 00010000:00080000:0.0:1787787328.894607:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d07222a2940 x1874630694455552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787328.894616:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07222a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694455552:0@lo:400:kworker.0 00000100:00100000:0.0:1787787328.894624:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07059752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1874630694455168:0@lo:400:kworker.0 00000100:00100000:0.0:1787787328.912855:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe82d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+7:0:x1874630678693632:12345-192.168.206.10@tcp:2:touch.500 Request processed in 45796us (46344us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787787328.913184:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 17 00000001:00100000:0.0:1787787328.913219:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c5599457-aa74-4a71-951f-faabe33e6ec7 00000001:00080000:0.0:1787787328.913231:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1787787328.915553:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787328.915642:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678693888 00000100:00100000:2.0:1787787328.915651:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678693888 00000100:00100000:2.0:1787787328.915717:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:2.0:1787787328.915736:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+10:9687:x1874630678693888:12345-192.168.206.10@tcp:35:touch.500 00000100:00100000:2.0:1787787328.916054:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+11:9687:x1874630678693888:12345-192.168.206.10@tcp:35:touch.500 Request processed in 328us (509us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787787328.916063:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:2.0:1787787328.943580:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787328.944018:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678694016 00000100:00100000:3.0:1787787328.944027:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678694016 00000100:00100000:3.0:1787787328.944122:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 25 00000100:00100000:3.0:1787787328.944133:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073476a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+11:9688:x1874630678694016:12345-192.168.206.10@tcp:101:rm.0 00010000:00010000:3.0:1787787328.944156:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787328.944176:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b123d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3504e expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.944253:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b1244 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.944267:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b1244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.944278:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b1244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787328.944331:0:9687:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787787328.944334:0:9687:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787787328.944392:0:9687:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b1244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.944416:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b123d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3504e expref: 13 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.944486:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b1244 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3504e expref: 12 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.944494:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d071b71de00) 00010000:00010000:3.0:1787787328.944497:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787787328.944500:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708771e00, rc 0) 00000100:00100000:3.0:1787787328.944558:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073476a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+12:9688:x1874630678694016:12345-192.168.206.10@tcp:101:rm.0 Request processed in 428us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787328.944565:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 25 00000100:00100000:1.0:1787787328.953540:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787328.953605:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678694272 00000100:00100000:0.0:1787787328.953615:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678694272 00000100:00100000:0.0:1787787328.953750:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 26 00000100:00100000:0.0:1787787328.953760:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+12:9688:x1874630678694272:12345-192.168.206.10@tcp:101:rm.0 00010000:00010000:0.0:1787787328.953779:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787328.953798:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e800/0xdeb1953cba4b124b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35055 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787328.953902:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787787328.954053:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e800/0xdeb1953cba4b124b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35055 expref: 14 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.954080:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d071b71d900) 00010000:00010000:0.0:1787787328.954082:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787787328.954088:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e800/0xdeb1953cba4b124b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35055 expref: 14 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.954102:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d070141e800, rc 0) 00000100:00100000:0.0:1787787328.954164:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+13:9688:x1874630678694272:12345-192.168.206.10@tcp:101:rm.0 Request processed in 405us (633us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1787787328.954172:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 26 00000100:00100000:1.0:1787787328.959716:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787328.959813:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678694400 00000100:00100000:2.0:1787787328.959822:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678694400 00000100:00100000:2.0:1787787328.959930:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 3 00000100:00100000:2.0:1787787328.959941:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+13:9688:x1874630678694400:12345-192.168.206.10@tcp:37:rm.0 00000100:00100000:2.0:1787787328.969802:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+13:9688:x1874630678694400:12345-192.168.206.10@tcp:37:rm.0 Request processed in 9853us (10093us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787328.969815:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 3 00000100:00100000:1.0:1787787328.975661:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787328.975883:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678694656 00000100:00100000:3.0:1787787328.975893:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678694656 00000100:00100000:3.0:1787787328.975950:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:3.0:1787787328.975959:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07190ef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+13:9688:x1874630678694656:12345-192.168.206.10@tcp:35:rm.0 00000100:00100000:3.0:1787787328.976774:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07190ef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+14:9688:x1874630678694656:12345-192.168.206.10@tcp:35:rm.0 Request processed in 814us (1119us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787787328.976784:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:1.0:1787787328.980330:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787328.980561:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678694912 00000100:00100000:0.0:1787787328.980570:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678694912 00000100:00100000:0.0:1787787328.980658:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 27 00000100:00100000:0.0:1787787328.980667:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+14:9688:x1874630678694912:12345-192.168.206.10@tcp:101:rm.0 00010000:00010000:0.0:1787787328.980690:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787328.980719:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e800/0xdeb1953cba4b1259 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3505c expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.980831:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141f600/0xdeb1953cba4b1260 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.980845:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141f600/0xdeb1953cba4b1260 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.980856:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141f600/0xdeb1953cba4b1260 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787328.980866:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787787328.981007:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e800/0xdeb1953cba4b1259 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3505c expref: 17 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.981034:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141f600/0xdeb1953cba4b1260 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3505c expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.981042:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d071b71de00) 00010000:00010000:0.0:1787787328.981045:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787787328.981048:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d070141f600, rc 0) 00000100:00100000:0.0:1787787328.981105:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+16:9688:x1874630678694912:12345-192.168.206.10@tcp:101:rm.0 Request processed in 439us (782us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787787328.981112:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 27 00000100:00100000:2.0:1787787328.985742:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787328.985820:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678695040 00000100:00100000:0.0:1787787328.985829:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678695040 00000100:00100000:0.0:1787787328.985885:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 28 00000100:00100000:0.0:1787787328.985895:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0734769680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+16:9688:x1874630678695040:12345-192.168.206.10@tcp:41:rm.0 00000004:00000024:0.0:1787787328.985950:0:5820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1787787328.986033:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0734769680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+16:9688:x1874630678695040:12345-192.168.206.10@tcp:41:rm.0 Request processed in 132us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787328.986041:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 28 00000100:00100000:1.0:1787787328.991119:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787328.991311:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678695168 00000100:00100000:3.0:1787787328.991320:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678695168 00000100:00100000:3.0:1787787328.991385:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 29 00000100:00100000:3.0:1787787328.991395:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+16:9688:x1874630678695168:12345-192.168.206.10@tcp:101:rm.0 00010000:00010000:3.0:1787787328.991426:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787328.991474:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b126e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35063 expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.991543:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771400/0xdeb1953cba4b1275 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.991571:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771400/0xdeb1953cba4b1275 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.991583:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771400/0xdeb1953cba4b1275 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.991598:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b127c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.991605:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b127c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.991612:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b127c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.991733:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1283 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.991742:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.991749:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787328.991773:0:9687:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787787328.991777:0:9687:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787787328.991792:0:9687:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.991803:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.991822:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771400/0xdeb1953cba4b1275 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.991828:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771400/0xdeb1953cba4b1275 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.991835:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771400/0xdeb1953cba4b1275 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.991841:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708771400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787328.991845:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771400/0xdeb1953cba4b1275 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.991852:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771400/0xdeb1953cba4b1275 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.991865:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d071b71de00) 00010000:00010000:3.0:1787787328.991868:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787328.991872:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771400/0xdeb1953cba4b1275 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.991879:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771400/0xdeb1953cba4b1275 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.991891:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b127c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.991898:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b127c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.991904:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b127c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.991915:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708770200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787328.991918:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b127c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.991925:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b127c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.991934:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x8b258fbb (ffff9d071b71d200) 00010000:00010000:3.0:1787787328.991936:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787328.991939:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b127c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.991946:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b127c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.991976:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b126e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35063 expref: 18 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.991989:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1283 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35063 expref: 17 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787328.991997:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d07078d0400) 00010000:00010000:3.0:1787787328.991999:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787787328.992002:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0700030800, rc 0) 00000100:00100000:3.0:1787787328.992082:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+17:9688:x1874630678695168:12345-192.168.206.10@tcp:101:rm.0 Request processed in 687us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787328.992090:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 29 00000100:00100000:1.0:1787787328.997892:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787328.998059:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678695424 00000100:00100000:0.0:1787787328.998070:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678695424 00000100:00100000:0.0:1787787328.998137:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 30 00000100:00100000:0.0:1787787328.998147:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+17:9688:x1874630678695424:12345-192.168.206.10@tcp:36:rm.0 00010000:00010000:0.0:1787787328.998316:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787787328.998341:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1283 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35063 expref: 17 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.998393:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b122f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35047 expref: 16 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.998404:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d07078d0400) 00010000:00010000:0.0:1787787328.998670:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b1244 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3504e expref: 15 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.998680:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d071b71de00) 00010000:00010000:0.0:1787787328.998684:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787787328.998711:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e800/0xdeb1953cba4b128a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.998723:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e800/0xdeb1953cba4b128a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.998731:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e800/0xdeb1953cba4b128a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.998745:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141fe00/0xdeb1953cba4b1291 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.998751:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141fe00/0xdeb1953cba4b1291 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.998757:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141fe00/0xdeb1953cba4b1291 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.999257:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141ee00/0xdeb1953cba4b1298 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.999278:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141ee00/0xdeb1953cba4b1298 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787328.999286:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141ee00/0xdeb1953cba4b1298 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787787329.000052:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1787787329.000065:0:5820:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 241226625676ns, next at 242226623418ns, rc = 0 00010000:00010000:0.0:1787787329.000196:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e000/0xdeb1953cba4b129f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787329.000209:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e000/0xdeb1953cba4b129f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787329.000219:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e000/0xdeb1953cba4b129f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787329.000227:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e000/0xdeb1953cba4b129f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787329.000233:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e000/0xdeb1953cba4b129f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787329.000240:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e000/0xdeb1953cba4b129f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787329.000266:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787787329.000286:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141ee00/0xdeb1953cba4b1298 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787329.000292:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141ee00/0xdeb1953cba4b1298 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787329.000305:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141ee00/0xdeb1953cba4b1298 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787329.000311:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d070141ee00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787329.000315:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141ee00/0xdeb1953cba4b1298 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787329.000323:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141ee00/0xdeb1953cba4b1298 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787329.000334:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d07096a0900) 00010000:00010000:0.0:1787787329.000337:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787787329.000341:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141ee00/0xdeb1953cba4b1298 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787329.000346:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141ee00/0xdeb1953cba4b1298 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787329.000363:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e800/0xdeb1953cba4b128a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787329.000368:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e800/0xdeb1953cba4b128a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787329.000374:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e800/0xdeb1953cba4b128a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787329.000379:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d070141e800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787329.000381:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e800/0xdeb1953cba4b128a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787329.000398:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e800/0xdeb1953cba4b128a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787329.000406:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d071b71de00) 00010000:00010000:0.0:1787787329.000409:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787329.000411:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e800/0xdeb1953cba4b128a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787329.000417:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e800/0xdeb1953cba4b128a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787787329.000427:0:5820:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000028629a35 reply state 000000009bee4793 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141fe00/0xdeb1953cba4b1291 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787329.000461:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787787329.000543:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+16:9688:x1874630678695424:12345-192.168.206.10@tcp:36:rm.0 Request processed in 2394us (2656us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787787329.000551:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 30 00010000:00010000:2.0:1787787329.000800:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787329.000818:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e000/0xdeb1953cba4b129f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787329.000825:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d070141e000 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:2.0:1787787329.000829:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e000/0xdeb1953cba4b129f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787329.000836:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e000/0xdeb1953cba4b129f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787329.000847:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d07096a0900) 00010000:00010000:2.0:1787787329.000849:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787787329.000853:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e000/0xdeb1953cba4b129f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787329.000859:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e000/0xdeb1953cba4b129f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787329.000874:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787329.000876:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787329.000878:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787329.004698:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141fe00/0xdeb1953cba4b1291 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787329.004724:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141fe00/0xdeb1953cba4b1291 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787329.004732:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141fe00/0xdeb1953cba4b1291 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787329.004739:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d070141fe00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787329.004743:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141fe00/0xdeb1953cba4b1291 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787329.004768:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141fe00/0xdeb1953cba4b1291 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787329.004785:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x8b258fbb (ffff9d07096a0400) 00010000:00010000:0.0:1787787329.004788:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787329.004793:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141fe00/0xdeb1953cba4b1291 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787329.004799:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141fe00/0xdeb1953cba4b1291 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x8b258fbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787329.008525:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787329.008631:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678695680 00000100:00100000:2.0:1787787329.008641:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678695680 00000100:00100000:2.0:1787787329.008724:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:2.0:1787787329.008735:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+15:9688:x1874630678695680:12345-192.168.206.10@tcp:35:rm.0 00000100:00100000:2.0:1787787329.008989:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+16:9688:x1874630678695680:12345-192.168.206.10@tcp:35:rm.0 Request processed in 248us (464us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787787329.008998:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00080000:0.0:1787787329.009057:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787329.012223:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787329.012302:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678695936 00000100:00100000:3.0:1787787329.012326:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678695936 00000100:00100000:3.0:1787787329.012388:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 31 00000100:00100000:3.0:1787787329.012398:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073476b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+16:9688:x1874630678695936:12345-192.168.206.10@tcp:36:rm.0 00010000:00010000:3.0:1787787329.012644:0:9687:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787787329.012673:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141f600/0xdeb1953cba4b1260 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3505c expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787329.012695:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b11fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35039 expref: 15 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787329.012717:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d071b71de00) 00010000:00010000:3.0:1787787329.012731:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771200/0xdeb1953cba4b11bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3502b expref: 14 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787329.012739:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d071b71d900) 00010000:00010000:3.0:1787787329.012744:0:9687:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787787329.012764:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b12a6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787329.012776:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b12a6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787329.012785:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b12a6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787329.012795:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b12ad lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787329.012901:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b12ad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787329.012921:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b12ad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787329.013216:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b12b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787329.013224:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b12b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787329.013232:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b12b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787329.014182:0:9687:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787787329.014198:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b12b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787329.014206:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b12b4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787329.014214:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b12b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787329.014220:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708770000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787329.014225:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b12b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787329.014233:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b12b4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787329.014245:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d071b71d700) 00010000:00010000:3.0:1787787329.014247:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787787329.014257:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b12b4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787329.014264:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b12b4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787329.014283:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b12a6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787329.014289:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b12a6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787329.014296:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b12a6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787329.014301:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0700030800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787329.014304:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b12a6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787329.014310:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b12a6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787329.014317:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d071b71d200) 00010000:00010000:3.0:1787787329.014319:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787329.014322:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b12a6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787329.014328:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b12a6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787787329.014338:0:9687:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000062d990a8 reply state 00000000b14aec5f transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b12ad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787329.014960:0:9687:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787787329.015051:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073476b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+15:9688:x1874630678695936:12345-192.168.206.10@tcp:36:rm.0 Request processed in 2651us (2832us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787787329.015060:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 31 00010000:00010000:0.0:1787787329.017632:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b12ad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787329.017649:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b12ad lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787329.017656:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b12ad lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787329.017662:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708771e00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787329.017666:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b12ad lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787329.017674:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b12ad lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787329.017690:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d071b71dd00) 00010000:00010000:0.0:1787787329.017693:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787329.017720:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b12ad lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787329.017727:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b12ad lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787329.148637:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787329.404830:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0734769e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694455680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787329.404900:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787329.405045:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694455680 00000100:00100000:1.0:1787787329.405057:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694455680 00000100:00100000:1.0:1787787329.405123:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787787329.405133:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694455680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787787329.405167:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787787329.405212:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694455680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787329.405219:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1787787329.405460:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0734769e00 x1874630694455680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787345 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787329.405479:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0734769e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694455680:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787787330.180613:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787787330.428734:0:6715:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 242655292634ns, next at 243655289983ns, rc = 0 00000100:00100000:1.0:1787787330.428746:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073c76de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694455808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787787330.428812:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787330.428900:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694455808 00000100:00100000:1.0:1787787330.428907:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694455808 00000100:00100000:1.0:1787787330.428954:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787787330.428963:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694455808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787787330.428997:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787787330.429052:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694455808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787330.429059:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1787787330.429222:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d073c76de00 x1874630694455808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787346 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787330.429240:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073c76de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694455808:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787787330.429296:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787787331.202058:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787332.228328:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787332.588616:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787332.588662:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787332.588713:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787332.588743:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787332.588774:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678696064 00000100:00100000:2.0:1787787332.588785:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678696064 00000100:00100000:2.0:1787787332.588836:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 243 00000100:00100000:2.0:1787787332.588846:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2344:x1874630678696064:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787787332.588912:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2344:x1874630678696064:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 68us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787332.588920:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 243 00000100:00100000:2.0:1787787332.588950:0:10776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678696320 00000100:00100000:2.0:1787787332.588954:0:10776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678696320 00000100:00100000:2.0:1787787332.589002:0:10776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 51 00000100:00100000:2.0:1787787332.589009:0:10776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2344:x1874630678696320:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787787332.589036:0:10776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2344:x1874630678696320:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 28us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787332.589059:0:10776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 51 00000100:00080000:2.0:1787787332.589147:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787787332.589788:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678696192 00000100:00100000:0.0:1787787332.589797:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678696192 00000100:00100000:0.0:1787787332.589877:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678696448 00000100:00100000:0.0:1787787332.589881:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678696448 00000100:00100000:1.0:1787787332.589955:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 91 00000100:00100000:1.0:1787787332.589966:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07347683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+14:2344:x1874630678696192:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787787332.590022:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07347683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+14:2344:x1874630678696192:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 59us (1416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787332.590029:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 91 00000100:00080000:2.0:1787787332.599159:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787332.600037:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 92 00000100:00100000:0.0:1787787332.600051:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0734769e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2344:x1874630678696448:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787787332.600129:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0734769e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2344:x1874630678696448:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 82us (11466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787332.600138:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 92 00000001:02000400:2.0:1787787332.736185:0:11604:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1787787333.246658:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787787333.752235:0:11652:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff8c382a90 20000000:00000080:2.0:1787787333.752264:0:11652:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d073767ec00 uarg=0000000000000000 20000000:01000000:2.0:1787787333.752316:0:11652:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787787333.752324:0:11652:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787787333.752331:0:11652:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1787787333.753726:0:11653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1787787333.753928:0:11652:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1787787333.764688:0:11652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1787787333.764760:0:11652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1787787333.764821:0:11652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1787787333.764846:0:11652:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787787333.764873:0:11652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d073fd39600/0xdeb1953cba4b12bb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787333.764896:0:11652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0708771600/0xdeb1953cba4b1164 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b115d expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787333.764904:0:11652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b1172 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b116b expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787333.764911:0:11652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0700031c00/0xdeb1953cba4b1180 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b1179 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787333.764922:0:11652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0700030e00/0xdeb1953cba4b1187 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35016 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787333.764943:0:11652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0700030200/0xdeb1953cba4b118e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3501d expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787333.764951:0:11652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d073fd39600/0xdeb1953cba4b12bb lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787333.765013:0:11652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0700030200/0xdeb1953cba4b118e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3501d expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787333.765031:0:11652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d0700030200/0xdeb1953cba4b118e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3501d expref: 12 pid: 5812 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787333.765048:0:11652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e46580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1874630694455936:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787787333.765882:0:11652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0700030e00/0xdeb1953cba4b1187 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35016 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787333.765896:0:11652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d0700030e00/0xdeb1953cba4b1187 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35016 expref: 12 pid: 5813 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787333.765908:0:11652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe01e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1874630694456064:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787787333.765960:0:11652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0700031c00/0xdeb1953cba4b1180 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b1179 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787333.765970:0:11652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0700031c00/0xdeb1953cba4b1180 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b1179 expref: 18 pid: 5813 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787333.765990:0:11652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe021c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1874630694456192:0@lo:104: 00000100:00100000:2.0:1787787333.766042:0:11652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787787333.766109:0:11652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b1172 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b116b expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787333.766118:0:11652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b1172 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b116b expref: 18 pid: 5813 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787333.766128:0:11652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe030c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1874630694456320:0@lo:104: 00000100:00100000:2.0:1787787333.766153:0:11652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787787333.766182:0:11652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0708771600/0xdeb1953cba4b1164 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b115d expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787333.766278:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694456192 00000100:00100000:0.0:1787787333.766287:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694456192 00000100:00100000:0.0:1787787333.766333:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694456320 00000100:00100000:0.0:1787787333.766336:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694456320 00000100:00100000:0.0:1787787333.766351:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787787333.766361:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe00f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+4:11652:x1874630694456192:12345-0@lo:104: 00010000:00010000:0.0:1787787333.766384:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9d073fd39400/0xdeb1953cba4b1179 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b1180 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787333.766456:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787787333.766463:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe00f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+4:11652:x1874630694456192:12345-0@lo:104: Request processed in 103us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787333.766472:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787787333.766492:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787787333.766498:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe01a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+3:11652:x1874630694456320:12345-0@lo:104: 00010000:00010000:0.0:1787787333.766505:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9d0708771800/0xdeb1953cba4b116b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b1172 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787333.766541:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787787333.766546:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe01a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+3:11652:x1874630694456320:12345-0@lo:104: Request processed in 49us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787333.766552:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1787787333.766569:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787787333.766576:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d073fd39400/0xdeb1953cba4b1179 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b1180 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787333.766584:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39400 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:0.0:1787787333.766589:0:8439:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d073fd39400/0xdeb1953cba4b1179 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b1180 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787333.766600:0:8439:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d073fd39400/0xdeb1953cba4b1179 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b1180 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787787333.766609:0:8439:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d073fd39400/0xdeb1953cba4b1179 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b1180 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787333.766623:0:8439:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787787333.766657:0:8439:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d073fd39400/0xdeb1953cba4b1179 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b1180 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787333.766665:0:8439:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787787333.766707:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d073fd39400/0xdeb1953cba4b1179 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b1180 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787333.766716:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d073fd39400/0xdeb1953cba4b1179 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b1180 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787333.766732:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787333.766736:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d0708771800/0xdeb1953cba4b116b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b1172 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787333.766742:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708771800 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:0.0:1787787333.766745:0:8439:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d0708771800/0xdeb1953cba4b116b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b1172 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787333.766752:0:8439:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d0708771800/0xdeb1953cba4b116b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b1172 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787787333.766760:0:8439:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d0708771800/0xdeb1953cba4b116b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b1172 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787333.766766:0:8439:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787787333.766779:0:8439:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d0708771800/0xdeb1953cba4b116b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b1172 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787333.766785:0:8439:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787787333.766807:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d0708771800/0xdeb1953cba4b116b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b1172 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787333.766814:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d0708771800/0xdeb1953cba4b116b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b1172 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787333.766825:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787333.766827:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787333.766829:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787333.766855:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073473c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694456576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787787333.766889:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787787333.766910:0:11652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0708771600/0xdeb1953cba4b1164 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b115d expref: 18 pid: 5812 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787333.766923:0:11652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe00780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1874630694456448:0@lo:104: 00000100:00100000:0.0:1787787333.766934:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073473e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694456704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787787333.766979:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787333.767013:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694456576 00000100:00100000:0.0:1787787333.767017:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694456576 00010000:00010000:0.0:1787787333.767036:0:8496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0700031c00/0xdeb1953cba4b1180 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b1179 expref: 19 pid: 5813 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787333.767057:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694456704 00000100:00100000:0.0:1787787333.767060:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694456704 00010000:00010000:0.0:1787787333.767070:0:8496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b1172 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b116b expref: 20 pid: 5813 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787333.767087:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787787333.767094:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1500c007-b35b-4004-b231-bb5a7ec082ef+20:3292:x1874630694456576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787787333.767105:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787333.767111:0:8496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0700031c00/0xdeb1953cba4b1180 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b1179 expref: 20 pid: 5813 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787333.767121:0:8496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0700031c00/0xdeb1953cba4b1180 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b1179 expref: 20 pid: 5813 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787333.767147:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787333.767174:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1500c007-b35b-4004-b231-bb5a7ec082ef+20:3292:x1874630694456576:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787333.767181:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787787333.767193:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787787333.767199:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3293:x1874630694456704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787787333.767209:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787333.767213:0:8496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b1172 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b116b expref: 19 pid: 5813 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787333.767221:0:8496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b1172 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b116b expref: 19 pid: 5813 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787333.767230:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787333.767252:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3293:x1874630694456704:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787333.767258:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787787333.767300:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073473e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694456704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787787333.767320:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073473c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694456576:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787787333.767665:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787333.768026:0:11652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787333.768076:0:11652:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07058a3480 going to sleep for 11 seconds 00010000:00010000:2.0:1787787333.768097:0:11652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0700031c00/0xdeb1953cba4b1180 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b1179 expref: 18 pid: 5813 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787333.768112:0:11652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe021c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1874630694456192:0@lo:104: 00010000:00010000:2.0:1787787333.768123:0:11652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b1172 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b116b expref: 17 pid: 5813 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787333.768131:0:11652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe030c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1874630694456320:0@lo:104: 00000100:00100000:3.0:1787787333.768945:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787333.769031:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787333.769140:0:11652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e46580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1874630694455936:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787787333.769151:0:11652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe01e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1874630694456064:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787787333.769204:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678696704 00000100:00100000:0.0:1787787333.769211:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678696704 00010000:00010000:0.0:1787787333.769249:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0700030e00/0xdeb1953cba4b1187 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35016 expref: 13 pid: 5813 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787333.769281:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678696576 00000100:00100000:0.0:1787787333.769285:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678696576 00010000:00010000:0.0:1787787333.769296:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0700030200/0xdeb1953cba4b118e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3501d expref: 14 pid: 5812 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787333.769340:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 32 00000100:00100000:0.0:1787787333.769348:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0708738c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+14:2344:x1874630678696704:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787333.769363:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787333.769368:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0700030e00/0xdeb1953cba4b1187 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35016 expref: 14 pid: 5813 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787333.769379:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0700030e00/0xdeb1953cba4b1187 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35016 expref: 14 pid: 5813 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787333.769398:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0700030e00/0xdeb1953cba4b1187 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35016 expref: 14 pid: 5813 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787333.769413:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787333.769942:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0708738c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2344:x1874630678696704:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 592us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787333.770162:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 32 00000100:00100000:2.0:1787787333.774116:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 33 00000100:00100000:2.0:1787787333.774154:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073c76f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+12:2344:x1874630678696576:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787333.774208:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787333.774381:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0700030200/0xdeb1953cba4b118e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3501d expref: 12 pid: 5812 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787333.774407:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0700030200/0xdeb1953cba4b118e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3501d expref: 12 pid: 5812 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787333.774432:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0700030200/0xdeb1953cba4b118e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3501d expref: 12 pid: 5812 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787333.774470:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787333.774916:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073c76f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+11:2344:x1874630678696576:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 652us (5752us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787333.774929:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 33 00000100:00100000:1.0:1787787333.775321:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787787333.775343:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694456448 00000100:00100000:1.0:1787787333.775353:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694456448 00000100:00100000:1.0:1787787333.775411:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787787333.775420:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073d8f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+3:11652:x1874630694456448:12345-0@lo:104: 00010000:00010000:1.0:1787787333.775466:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9d0700031a00/0xdeb1953cba4b115d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b1164 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787333.775962:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787787333.775970:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073d8f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+3:11652:x1874630694456448:12345-0@lo:104: Request processed in 551us (7945us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787333.775978:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787787333.776131:0:11652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe00780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1874630694456448:0@lo:104: 00010000:00010000:2.0:1787787333.776176:0:11652:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d073fd39600/0xdeb1953cba4b12bb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787333.776299:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787333.776309:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d0700031a00/0xdeb1953cba4b115d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b1164 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787333.776319:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0700031a00 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:3.0:1787787333.776324:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d0700031a00/0xdeb1953cba4b115d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b1164 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787333.776335:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d0700031a00/0xdeb1953cba4b115d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b1164 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787787333.776342:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d0700031a00/0xdeb1953cba4b115d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b1164 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787333.776348:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787787333.776400:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d0700031a00/0xdeb1953cba4b115d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b1164 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787333.776406:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787787333.776470:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d0700031a00/0xdeb1953cba4b115d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b1164 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787333.776478:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d0700031a00/0xdeb1953cba4b115d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b1164 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787333.776496:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787333.776498:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787333.776500:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787333.776994:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073c76da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694456832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787333.777056:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787333.777167:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694456832 00000100:00100000:3.0:1787787333.777175:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694456832 00010000:00010000:3.0:1787787333.777208:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0708771600/0xdeb1953cba4b1164 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b115d expref: 17 pid: 5812 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787333.777246:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787787333.777257:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe00780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1500c007-b35b-4004-b231-bb5a7ec082ef+17:3294:x1874630694456832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787787333.777271:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787333.777277:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9d0708771600/0xdeb1953cba4b1164 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b115d expref: 17 pid: 5812 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787333.777294:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0708771600/0xdeb1953cba4b1164 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b115d expref: 17 pid: 5812 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787333.777316:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0708771600/0xdeb1953cba4b1164 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b115d expref: 17 pid: 5812 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787333.777334:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d073fd39600/0xdeb1953cba4b12bb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787333.777344:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d073fd39600/0xdeb1953cba4b12bb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787333.777373:0:5805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d073fd39600/0xdeb1953cba4b12bb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787333.777382:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d073fd39600/0xdeb1953cba4b12bb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787333.777389:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d073fd39600/0xdeb1953cba4b12bb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787333.777397:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d073fd39600/0xdeb1953cba4b12bb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787333.777403:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39600 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787333.777408:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d073fd39600/0xdeb1953cba4b12bb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787333.777430:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d073fd39600/0xdeb1953cba4b12bb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787333.777486:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d073fd39600/0xdeb1953cba4b12bb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787333.777499:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787333.777545:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe00780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1500c007-b35b-4004-b231-bb5a7ec082ef+16:3294:x1874630694456832:12345-0@lo:103:ldlm_bl.0 Request processed in 290us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787333.777555:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:3.0:1787787333.778835:0:11652:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d073fd39600/0xdeb1953cba4b12bb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787333.778854:0:11652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d073fd39600/0xdeb1953cba4b12bb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787333.778877:0:11652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d073fd39600/0xdeb1953cba4b12bb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787333.784087:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073c76da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694456832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787334.013352:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe03840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1874630694457344:0@lo:400:kworker.0 00000100:00100000:2.0:1787787334.013467:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787334.013541:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787787334.013547:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694457216:0@lo:400:kworker.0 00000100:00100000:2.0:1787787334.013574:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787334.013623:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694457216 00000100:00100000:2.0:1787787334.013631:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694457216 00000100:00100000:0.0:1787787334.013753:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe01e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1874630694456960:0@lo:400:kworker.0 00000100:00100000:0.0:1787787334.013788:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787334.013806:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe00b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694457472:0@lo:400:kworker.0 00000100:00100000:0.0:1787787334.013828:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787334.013854:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787787334.013860:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe030c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694457088:0@lo:400:kworker.0 00000100:00100000:0.0:1787787334.013883:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787334.013910:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694457472 00000100:00100000:0.0:1787787334.013913:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694457472 00000100:00100000:0.0:1787787334.013977:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787787334.013993:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694457472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787334.014050:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694457472:12345-0@lo:400:kworker.0 Request processed in 58us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787334.014057:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787787334.014082:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694457344 00000100:00100000:0.0:1787787334.014086:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694457344 00000100:00100000:0.0:1787787334.014114:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694456960 00000100:00100000:0.0:1787787334.014116:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694456960 00000100:00100000:0.0:1787787334.014129:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694457088 00000100:00100000:0.0:1787787334.014131:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694457088 00000100:00100000:0.0:1787787334.014145:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787787334.014151:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe02580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874630694457344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787334.014186:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe02580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874630694457344:12345-0@lo:400:kworker.0 Request processed in 36us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787334.014192:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787787334.014203:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787787334.014208:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1874630694456960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787334.014232:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1874630694456960:12345-0@lo:400:kworker.0 Request processed in 25us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787334.014237:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787787334.014247:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787787334.014252:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694457088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787334.014274:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694457088:12345-0@lo:400:kworker.0 Request processed in 23us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787334.014280:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787787334.014324:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe030c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694457088:0@lo:400:kworker.0 00000100:00100000:0.0:1787787334.014344:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe01e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1874630694456960:0@lo:400:kworker.0 00010000:00080000:0.0:1787787334.014354:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d073fe00b40 x1874630694457472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787334.014364:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe00b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694457472:0@lo:400:kworker.0 00000100:00080000:0.0:1787787334.014409:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787787334.014415:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787787334.014454:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe03840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1874630694457344:0@lo:400:kworker.0 00000100:00080000:0.0:1787787334.014688:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787334.014783:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787787334.014792:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe00f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694457216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787334.014840:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe00f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694457216:12345-0@lo:400:kworker.0 Request processed in 51us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787334.014846:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1787787334.014906:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d073fe021c0 x1874630694457216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787334.014916:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694457216:0@lo:400:kworker.0 00000001:00080000:3.0:1787787334.074092:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:3.0:1787787334.074110:0:5842:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1787787334.074142:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:3.0:1787787334.074152:0:5842:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1787787334.074164:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:0.0:1787787334.074965:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694457600:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787787334.075065:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787334.075515:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694457600 00000100:00100000:1.0:1787787334.075525:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694457600 00000100:00100000:1.0:1787787334.075587:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787787334.075608:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694457600:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787787334.075641:0:6674:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1787787334.075861:0:6674:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a8f7840, atime: 0x6a8f7840, ctime: 0x6a8f7840, blocks: 0x1 00010000:00010000:1.0:1787787334.075872:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004feaad95/0xdeb1953cba4b12c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787334.075890:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=246s v=(0 0) 00010000:00010000:1.0:1787787334.075911:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787334.075919:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004feaad95/0xdeb1953cba4b12c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787334.075937:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004feaad95/0xdeb1953cba4b12c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787334.075948:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004feaad95/0xdeb1953cba4b12c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787334.075957:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004feaad95/0xdeb1953cba4b12c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787334.075985:0:6674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787787334.076417:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787334.076426:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004feaad95/0xdeb1953cba4b12c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787334.076473:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212ba00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:2.0:1787787334.076479:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004feaad95/0xdeb1953cba4b12c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787334.076491:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004feaad95/0xdeb1953cba4b12c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787334.076513:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004feaad95/0xdeb1953cba4b12c2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787334.076521:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004feaad95/0xdeb1953cba4b12c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787334.076544:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787334.076546:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787334.076548:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787334.077530:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3292:x1874630694457600:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1928us (2460us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787787334.077543:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:1.0:1787787334.077897:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d073fe83480/2, rc 0, transno 4294967300 00000100:00100000:1.0:1787787334.077906:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694457600:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1787787334.269652:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787334.529016:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787787334.529048:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe01a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694457728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787787334.529136:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787334.531160:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694457728 00000100:00100000:2.0:1787787334.531199:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694457728 00000100:00100000:2.0:1787787334.531281:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787787334.531293:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe83840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694457728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787787334.531340:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787334.531477:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe83840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694457728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 185us (2340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787334.531485:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1787787334.531661:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d073fe01a40 x1874630694457728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787334.531765:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe01a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694457728:0@lo:13:osp-pre-1-0.0 10000000:01000000:1.0:1787787335.164781:0:5817:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787787335.164789:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d070598a000 from 7 10000000:01000000:1.0:1787787335.164794:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787787335.164843:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d072212a800/0xdeb1953cba4b12c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787335.164873:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d072212a800/0xdeb1953cba4b12c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787335.164885:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d072212a800/0xdeb1953cba4b12c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787335.164911:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe81e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694457856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787787335.164987:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787335.165060:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071844b180 going to sleep for 11 seconds 00000100:00100000:0.0:1787787335.165190:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694457856 00000100:00100000:0.0:1787787335.165198:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694457856 00000100:00100000:0.0:1787787335.165248:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787787335.165257:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+16:5817:x1874630694457856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787335.165270:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787335.165283:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d070141fe00/0xdeb1953cba4b12d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b12c9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787335.165319:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d070141fe00/0xdeb1953cba4b12d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b12c9 expref: 17 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787335.165330:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d070141fe00/0xdeb1953cba4b12d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b12c9 expref: 17 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787335.165340:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d070141fe00, rc 0) 00000100:00100000:0.0:1787787335.165388:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+17:5817:x1874630694457856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787335.165395:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787787335.165498:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe81e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694457856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787335.165513:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d072212a800/0xdeb1953cba4b12c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b12d0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787335.165523:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d072212a800/0xdeb1953cba4b12c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b12d0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787335.165577:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe81e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694457984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787335.165602:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787335.165679:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071844b180 going to sleep for 11 seconds 00000100:00100000:0.0:1787787335.169363:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694457984 00000100:00100000:0.0:1787787335.169379:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694457984 00000100:00100000:0.0:1787787335.169461:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787787335.169472:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+17:5817:x1874630694457984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787335.169876:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+17:5817:x1874630694457984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 404us (4270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787335.169884:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787787335.170018:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe81e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694457984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787335.170070:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073c76cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694458112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787787335.170117:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787335.170155:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07058a3480 going to sleep for 11 seconds 00000100:00100000:2.0:1787787335.172251:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694458112 00000100:00100000:2.0:1787787335.172265:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694458112 00000100:00100000:2.0:1787787335.172311:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787787335.172319:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+17:5817:x1874630694458112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787335.172567:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+17:5817:x1874630694458112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 248us (2449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787335.172575:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787787335.174785:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073c76cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694458112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787787335.175387:0:11666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073c76cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:11666:1874630694458240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787787335.175494:0:11666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787335.175539:0:11666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07058a39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787335.175996:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694458240 00000100:00100000:2.0:1787787335.176004:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694458240 00000100:00100000:2.0:1787787335.176042:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787787335.176051:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+17:11666:x1874630694458240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787335.176275:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+17:11666:x1874630694458240:12345-0@lo:502:llog_process_th.0 Request processed in 224us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787335.176284:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787787335.176475:0:11666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073c76cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:11666:1874630694458240:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787787335.176513:0:11666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787335.176524:0:11666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787335.176526:0:11666:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787787335.176533:0:11666:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d070598a000 00000020:00000080:3.0:1787787335.176536:0:11666:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787787335.176621:0:11666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073c76cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:11666:1874630694458368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787787335.176661:0:11666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787335.176718:0:11666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0706984180 going to sleep for 11 seconds 00000100:00100000:1.0:1787787335.179700:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694458368 00000100:00100000:1.0:1787787335.179720:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694458368 00000100:00100000:1.0:1787787335.179768:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787787335.179779:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+17:11666:x1874630694458368:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787335.180031:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+17:11666:x1874630694458368:12345-0@lo:502:llog_process_th.0 Request processed in 254us (3369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787335.180038:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1787787335.180283:0:11666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073c76cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:11666:1874630694458368:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787787335.180331:0:11666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787335.180339:0:11666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787335.180341:0:11666:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787787335.180346:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787787335.180474:0:5817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787787335.180494:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787787335.180504:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d072212a800/0xdeb1953cba4b12c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b12d0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787335.180514:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d072212a800/0xdeb1953cba4b12c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b12d0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787335.180524:0:5817:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787787335.180526:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d0707278800 from 7 10000000:01000000:1.0:1787787335.180529:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787787335.180556:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d072212bc00/0xdeb1953cba4b12d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787335.180563:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d072212bc00/0xdeb1953cba4b12d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787335.180572:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d072212bc00/0xdeb1953cba4b12d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787335.180591:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe81e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694458496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787787335.180626:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787335.180651:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071844b840 going to sleep for 11 seconds 00000100:00100000:2.0:1787787335.180728:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694458496 00000100:00100000:2.0:1787787335.180733:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694458496 00000100:00100000:2.0:1787787335.180769:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1787787335.180776:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+17:5817:x1874630694458496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787335.180785:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787335.180804:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d073fd39c00/0xdeb1953cba4b12de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b12d7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787335.180825:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d073fd39c00/0xdeb1953cba4b12de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b12d7 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787335.180835:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d073fd39c00/0xdeb1953cba4b12de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b12d7 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787335.180842:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd39c00, rc 0) 00000100:00100000:2.0:1787787335.180886:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+18:5817:x1874630694458496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787335.180892:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787787335.181005:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe81e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694458496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787335.181019:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d072212bc00/0xdeb1953cba4b12d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b12de expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787335.181028:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d072212bc00/0xdeb1953cba4b12d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b12de expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787335.181082:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe81e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694458624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787335.181107:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787335.181136:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071844b840 going to sleep for 11 seconds 00000100:00100000:3.0:1787787335.181995:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694458624 00000100:00100000:3.0:1787787335.182004:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694458624 00000100:00100000:3.0:1787787335.182042:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1787787335.182049:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+18:5817:x1874630694458624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787335.182293:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+18:5817:x1874630694458624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 243us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787335.182301:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787787335.182400:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe81e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694458624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787335.182467:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe81e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694458752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787335.182508:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787335.182534:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071844b840 going to sleep for 11 seconds 00000100:00100000:3.0:1787787335.182602:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694458752 00000100:00100000:3.0:1787787335.182606:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694458752 00000100:00100000:3.0:1787787335.182628:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1787787335.182633:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+18:5817:x1874630694458752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787787335.182775:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+18:5817:x1874630694458752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787335.182782:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787787335.182906:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe81e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694458752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787787335.185373:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073c76cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:11668:1874630694458880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787787335.185476:0:11668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787335.185616:0:11668:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07093d5240 going to sleep for 11 seconds 00000100:00100000:2.0:1787787335.193019:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694458880 00000100:00100000:2.0:1787787335.193034:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694458880 00000100:00100000:2.0:1787787335.193481:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787787335.193494:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+18:11668:x1874630694458880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787335.193792:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+18:11668:x1874630694458880:12345-0@lo:502:llog_process_th.0 Request processed in 300us (8315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787335.193800:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1787787335.193837:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073c76cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:11668:1874630694458880:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787787335.193886:0:11668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787335.193895:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787335.193897:0:11668:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787787335.193903:0:11668:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d0707278800 00000020:00000080:0.0:1787787335.193906:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787787335.194162:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe81e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:11668:1874630694459008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787335.194206:0:11668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787335.194522:0:11668:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071844b840 going to sleep for 11 seconds 00000100:00100000:1.0:1787787335.194738:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694459008 00000100:00100000:1.0:1787787335.194862:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694459008 00000100:00100000:1.0:1787787335.194911:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787787335.194919:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+18:11668:x1874630694459008:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787335.195975:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+18:11668:x1874630694459008:12345-0@lo:502:llog_process_th.0 Request processed in 1052us (1764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787335.195986:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000040:00080000:3.0:1787787335.199243:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787787335.201568:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe81e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:11668:1874630694459008:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787787335.201638:0:11668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787335.201655:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787335.201657:0:11668:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787787335.201662:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787787335.208114:0:5817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787787335.208153:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787787335.208165:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d072212bc00/0xdeb1953cba4b12d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b12de expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787335.208178:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d072212bc00/0xdeb1953cba4b12d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b12de expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787335.208259:0:5817:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787787335.208263:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d0722109800 from 7 10000000:01000000:3.0:1787787335.208267:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787787335.208304:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0708771600/0xdeb1953cba4b12e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787335.208322:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d0708771600/0xdeb1953cba4b12e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787335.208333:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d0708771600/0xdeb1953cba4b12e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787335.208357:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073c76fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694459136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787787335.208418:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787335.208508:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07093d5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787335.209487:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694459136 00000100:00100000:0.0:1787787335.209497:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694459136 00000100:00100000:0.0:1787787335.209550:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1787787335.209560:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+18:5817:x1874630694459136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787335.209574:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787335.209588:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d070141e800/0xdeb1953cba4b12ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b12e5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787335.209613:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d070141e800/0xdeb1953cba4b12ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b12e5 expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787335.209624:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d070141e800/0xdeb1953cba4b12ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b12e5 expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787335.209633:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d070141e800, rc 0) 00000100:00100000:0.0:1787787335.209706:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:5817:x1874630694459136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787335.209713:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787787335.211361:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073c76fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694459136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787787335.211385:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d0708771600/0xdeb1953cba4b12e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b12ec expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787335.211397:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d0708771600/0xdeb1953cba4b12e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b12ec expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787335.211491:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073c76fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694459264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787335.211539:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787335.211582:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07093d5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787335.211642:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694459264 00000100:00100000:0.0:1787787335.211648:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694459264 00000100:00100000:0.0:1787787335.211695:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787787335.211704:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0706abdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:5817:x1874630694459264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787335.211968:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0706abdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:5817:x1874630694459264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 265us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787335.211977:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1787787335.212529:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073c76fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694459264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787335.212573:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe01a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694459392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787335.212615:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787335.212732:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0706aaa840 going to sleep for 11 seconds 00000100:00100000:0.0:1787787335.213208:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694459392 00000100:00100000:0.0:1787787335.213220:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694459392 00000100:00100000:0.0:1787787335.213268:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787787335.213275:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:5817:x1874630694459392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787787335.213738:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:5817:x1874630694459392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 463us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787335.213755:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1787787335.214091:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe01a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1500c007-b35b-4004-b231-bb5a7ec082ef:5817:1874630694459392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787335.214778:0:11672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe01a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:11672:1874630694459520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787335.214847:0:11672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787335.214877:0:11672:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0706aaaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787787335.215109:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694459520 00000100:00100000:0.0:1787787335.215116:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694459520 00000100:00100000:0.0:1787787335.215167:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1787787335.215176:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:11672:x1874630694459520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787787335.215635:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:11672:x1874630694459520:12345-0@lo:502:llog_process_th.0 Request processed in 457us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787335.215644:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787787335.217178:0:11672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe01a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:11672:1874630694459520:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787787335.217242:0:11672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787787335.217252:0:11672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787335.217255:0:11672:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787787335.217264:0:11672:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d0722109800 00000020:00000080:2.0:1787787335.217267:0:11672:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787787335.217611:0:11672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe01a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:11672:1874630694459648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787787335.221996:0:11672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787335.222055:0:11672:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0706aaaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787787335.222182:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694459648 00000100:00100000:0.0:1787787335.222191:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694459648 00000100:00100000:0.0:1787787335.222253:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787787335.222263:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:11672:x1874630694459648:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787787335.222537:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:11672:x1874630694459648:12345-0@lo:502:llog_process_th.0 Request processed in 274us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787335.222545:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787787335.224257:0:11672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe01a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1500c007-b35b-4004-b231-bb5a7ec082ef:11672:1874630694459648:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787787335.224316:0:11672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787335.224326:0:11672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787335.224329:0:11672:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787787335.224337:0:11672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787787335.224904:0:5817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787787335.224926:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787787335.224937:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0708771600/0xdeb1953cba4b12e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b12ec expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787335.224949:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d0708771600/0xdeb1953cba4b12e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b12ec expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787335.292708:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787335.331584:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787335.332283:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678696832 00000100:00100000:2.0:1787787335.332295:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678696832 00000100:00100000:2.0:1787787335.332352:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 259 00000100:00100000:2.0:1787787335.332362:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+11:5584:x1874630678696832:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787335.332376:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787335.332392:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d073fd38e00/0xdeb1953cba4b12f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3506a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787335.332418:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d073fd38e00/0xdeb1953cba4b12f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3506a expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787335.332429:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d073fd38e00/0xdeb1953cba4b12f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3506a expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787335.332484:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd38e00, rc 0) 00000100:00100000:3.0:1787787335.332683:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+12:5584:x1874630678696832:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 Request processed in 320us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787335.332691:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 259 00000100:00100000:0.0:1787787335.336644:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787335.342514:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678696960 00000100:00100000:2.0:1787787335.342535:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678696960 00000100:00100000:2.0:1787787335.342632:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 260 00000100:00100000:2.0:1787787335.342644:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+12:5584:x1874630678696960:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787335.343169:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+12:5584:x1874630678696960:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 Request processed in 524us (6537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787335.343180:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 260 00000100:00100000:1.0:1787787335.345854:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787335.346476:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678697088 00000100:00100000:0.0:1787787335.346491:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678697088 00000100:00100000:0.0:1787787335.346556:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 261 00000100:00100000:0.0:1787787335.346568:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+12:5584:x1874630678697088:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787787335.346855:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+12:5584:x1874630678697088:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 Request processed in 288us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787335.346864:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 261 00000100:00100000:0.0:1787787335.351830:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787335.355295:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678697216 00000100:00100000:3.0:1787787335.355390:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678697216 00000100:00100000:3.0:1787787335.356385:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 262 00000100:00100000:3.0:1787787335.356412:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+12:9958:x1874630678697216:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787787335.356788:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+12:9958:x1874630678697216:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 390us (4972us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787335.356797:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 262 00000100:00100000:1.0:1787787335.364188:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787335.364383:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678697344 00000100:00100000:2.0:1787787335.364397:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678697344 00000100:00100000:2.0:1787787335.364575:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 263 00000100:00100000:2.0:1787787335.364587:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+12:9958:x1874630678697344:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787787335.365032:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+12:9958:x1874630678697344:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 444us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787335.365041:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 263 00000100:00100000:1.0:1787787335.391850:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787335.392382:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678697472 00000100:00100000:3.0:1787787335.392395:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678697472 00000100:00100000:3.0:1787787335.392858:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 264 00000100:00100000:3.0:1787787335.392871:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+12:5584:x1874630678697472:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787787335.392892:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787335.392912:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0708771200/0xdeb1953cba4b12fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35071 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787335.392947:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0708771200/0xdeb1953cba4b12fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35071 expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787335.392961:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0708771200/0xdeb1953cba4b12fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35071 expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787335.392971:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708771200, rc 0) 00000100:00100000:3.0:1787787335.393067:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:5584:x1874630678697472:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 Request processed in 199us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787335.393075:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 264 00000100:00100000:3.0:1787787335.403732:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787335.403913:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678697600 00000100:00100000:2.0:1787787335.403926:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678697600 00000100:00100000:2.0:1787787335.403990:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 265 00000100:00100000:2.0:1787787335.404001:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:5584:x1874630678697600:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787335.404798:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:5584:x1874630678697600:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 Request processed in 794us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787335.404809:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 265 00000100:00100000:1.0:1787787335.417029:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787335.417385:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678697728 00000100:00100000:0.0:1787787335.417398:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678697728 00000100:00100000:0.0:1787787335.417571:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 266 00000100:00100000:0.0:1787787335.417582:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:5584:x1874630678697728:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787787335.417863:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:5584:x1874630678697728:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 Request processed in 281us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787335.417871:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 266 00000100:00100000:1.0:1787787335.420950:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787335.427796:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678697856 00000100:00100000:3.0:1787787335.427818:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678697856 00000100:00100000:3.0:1787787335.427913:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 267 00000100:00100000:3.0:1787787335.427925:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:9961:x1874630678697856:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787787335.430116:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:9961:x1874630678697856:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 2179us (9165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787335.430153:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 267 00000100:00100000:1.0:1787787335.446239:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787335.446938:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678697984 00000100:00100000:3.0:1787787335.446954:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678697984 00000100:00100000:2.0:1787787335.447208:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 268 00000100:00100000:2.0:1787787335.447222:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:9961:x1874630678697984:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787787335.447633:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:9961:x1874630678697984:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 412us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787335.447644:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 268 00000100:00100000:1.0:1787787335.549913:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073c76f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694459776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787787335.550010:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787335.551977:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694459776 00000100:00100000:2.0:1787787335.551996:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694459776 00000100:00100000:2.0:1787787335.552068:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787787335.552077:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe81e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1874630694459776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787787335.552126:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787335.552294:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe81e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1874630694459776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 216us (2282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787335.552302:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787787335.552592:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073c76f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694459776:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1787787336.253542:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787787336.318141:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787337.342342:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787337.701769:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787337.701872:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678698112 00000100:00100000:2.0:1787787337.701884:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678698112 00000100:00100000:2.0:1787787337.701951:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 269 00000100:00100000:2.0:1787787337.701962:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2345:x1874630678698112:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787787337.702051:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2345:x1874630678698112:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 91us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787337.702060:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 269 00000100:00100000:0.0:1787787337.711121:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787337.711567:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678698240 00000100:00100000:2.0:1787787337.711591:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678698240 00000100:00100000:2.0:1787787337.711705:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 96 00000100:00100000:2.0:1787787337.711752:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073476bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2345:x1874630678698240:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787787337.711871:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073476bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2345:x1874630678698240:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 125us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787337.711880:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 96 00000100:00080000:0.0:1787787337.712748:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787337.716894:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787337.716950:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787337.717130:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678698496 00000100:00100000:1.0:1787787337.717144:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678698496 00000100:00100000:1.0:1787787337.717250:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 97 00000100:00100000:1.0:1787787337.717263:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073c76e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2344:x1874630678698496:12345-192.168.206.10@tcp:400:kworker.0 00000100:00080000:0.0:1787787337.717509:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787787337.717636:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073c76e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2344:x1874630678698496:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 375us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787337.717645:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 97 00000100:00100000:2.0:1787787337.721019:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678698368 00000100:00100000:2.0:1787787337.721036:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678698368 00000100:00100000:2.0:1787787337.721160:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 54 00000100:00100000:2.0:1787787337.721172:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073c76e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2344:x1874630678698368:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787787337.721285:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073c76e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2344:x1874630678698368:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 116us (4334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787337.721294:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 54 00000100:00080000:0.0:1787787337.721556:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787787338.364739:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787339.133212:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073c76fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694460288:0@lo:400:kworker.0 00000100:00100000:3.0:1787787339.133226:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073c76f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1874630694460160:0@lo:400:kworker.0 00000100:00100000:1.0:1787787339.133302:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073c76c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694459904:0@lo:400:kworker.0 00000100:00100000:2.0:1787787339.136137:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073c76cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874630694460032:0@lo:400:kworker.0 00000100:00100000:0.0:1787787339.138571:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787339.139217:0:10776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694460288 00000100:00100000:1.0:1787787339.139243:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787339.139248:0:10776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694460288 00000100:00100000:1.0:1787787339.139288:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073c76cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1874630694460416:0@lo:400:kworker.0 00000100:00100000:1.0:1787787339.139326:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787339.139364:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694459904 00000100:00100000:1.0:1787787339.139369:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694459904 00000100:00100000:1.0:1787787339.139417:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787787339.139426:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3291:x1874630694459904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787339.139500:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3291:x1874630694459904:12345-0@lo:400:kworker.0 Request processed in 75us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787339.139508:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787787339.139545:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694460416 00000100:00100000:1.0:1787787339.139549:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694460416 00000100:00100000:1.0:1787787339.139586:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787787339.139593:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1874630694460416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787339.139644:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1874630694460416:12345-0@lo:400:kworker.0 Request processed in 51us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787339.139663:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787787339.139706:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073c76c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694459904:0@lo:400:kworker.0 00000100:00100000:1.0:1787787339.139723:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073c76cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1874630694460416:0@lo:400:kworker.0 00000100:00100000:0.0:1787787339.139750:0:10776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787787339.139761:0:10776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07222a2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3294:x1874630694460288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787339.139877:0:10776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07222a2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3294:x1874630694460288:12345-0@lo:400:kworker.0 Request processed in 118us (1316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787339.139885:0:10776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1787787339.139908:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787787339.139913:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787787339.139948:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073c76fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694460288:0@lo:400:kworker.0 00000100:00100000:2.0:1787787339.141166:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787339.141209:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694460032 00000100:00100000:2.0:1787787339.141218:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694460032 00000100:00100000:2.0:1787787339.141271:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787787339.141283:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1874630694460032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787339.141334:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1874630694460032:12345-0@lo:400:kworker.0 Request processed in 55us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787339.141341:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787787339.141391:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073c76cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874630694460032:0@lo:400:kworker.0 00000100:00100000:2.0:1787787339.141403:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073c76da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694460544:0@lo:400:kworker.0 00000100:00100000:2.0:1787787339.141465:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787339.141531:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694460544 00000100:00100000:0.0:1787787339.141536:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694460544 00000100:00100000:0.0:1787787339.141749:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787787339.141759:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe03840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694460544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787339.141809:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe03840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694460544:12345-0@lo:400:kworker.0 Request processed in 52us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787339.141816:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1787787339.141888:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787787339.141915:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d073c76da40 x1874630694460544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787339.142011:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073c76da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694460544:0@lo:400:kworker.0 00000100:00100000:3.0:1787787339.145930:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787339.146066:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694460160 00000100:00100000:2.0:1787787339.146077:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694460160 00000100:00100000:2.0:1787787339.146167:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787787339.146178:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073c76de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874630694460160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787339.146265:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073c76de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874630694460160:12345-0@lo:400:kworker.0 Request processed in 89us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787339.146272:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787787339.146358:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073c76f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1874630694460160:0@lo:400:kworker.0 00000100:00080000:0.0:1787787339.146431:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1787787339.191387:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:3.0:1787787339.392193:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787339.644998:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe00b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694460672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787787339.645100:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787339.646451:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694460672 00000100:00100000:2.0:1787787339.646469:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694460672 00000100:00100000:2.0:1787787339.646734:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787787339.646748:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e48f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694460672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787787339.646796:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787339.646921:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e48f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694460672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 176us (1822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787339.646929:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1787787339.647043:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d073fe00b40 x1874630694460672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787355 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787339.647066:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe00b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694460672:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787787340.414318:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787340.668909:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694460800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787787340.669026:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787340.669161:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694460800 00000100:00100000:2.0:1787787340.669171:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694460800 00000100:00100000:2.0:1787787340.669227:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787787340.669237:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0722250780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694460800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787787340.669272:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787340.669376:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0722250780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694460800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787340.669386:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787787340.669420:0:3294:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1787787340.669428:0:3294:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d073fe83480, transno 4294967300 00000100:00100000:0.0:1787787340.669524:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694460800:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787787341.436980:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787342.460588:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787342.818241:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787342.818293:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787342.818329:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787342.818364:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787342.818409:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678698752 00000100:00100000:3.0:1787787342.818419:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678698752 00000100:00100000:1.0:1787787342.818428:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678699008 00000100:00100000:1.0:1787787342.818431:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678699008 00000100:00100000:3.0:1787787342.818498:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 101 00000100:00100000:3.0:1787787342.818512:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073c76cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2343:x1874630678699008:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787342.818579:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073c76cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2343:x1874630678699008:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 70us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787342.818680:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678698624 00000100:00100000:2.0:1787787342.818685:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678698624 00000100:00100000:2.0:1787787342.818711:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 271 00000100:00100000:2.0:1787787342.818718:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2343:x1874630678698624:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787787342.818744:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2343:x1874630678698624:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 27us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787342.818749:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 271 00000100:00100000:0.0:1787787342.818933:0:10776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678698880 00000100:00100000:0.0:1787787342.818938:0:10776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678698880 00000100:00100000:0.0:1787787342.818968:0:10776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 57 00000100:00100000:0.0:1787787342.818976:0:10776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073c76f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2343:x1874630678698880:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787787342.818992:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 102 00000100:00100000:1.0:1787787342.819001:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073c76da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2343:x1874630678698752:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787787342.819010:0:10776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073c76f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2343:x1874630678698880:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 36us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787342.819016:0:10776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 57 00000100:00100000:1.0:1787787342.819025:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073c76da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2343:x1874630678698752:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 27us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787342.819031:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 102 00000100:00080000:0.0:1787787342.819072:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787787342.819076:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787342.819655:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 101 00010000:00010000:3.0:1787787343.484823:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787344.260110:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073c76cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874630694461056:0@lo:400:kworker.0 00000100:00100000:2.0:1787787344.260172:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787344.260219:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0702fd6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694461568:0@lo:400:kworker.0 00000100:00100000:2.0:1787787344.260241:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787344.260333:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787787344.260341:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073c76fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694460928:0@lo:400:kworker.0 00000100:00100000:2.0:1787787344.260370:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787344.260393:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1874630694461440:0@lo:400:kworker.0 00000100:00100000:2.0:1787787344.260415:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787344.260455:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073c76c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1874630694461184:0@lo:400:kworker.0 00000100:00100000:2.0:1787787344.260632:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787344.260657:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787787344.260663:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694461312:0@lo:400:kworker.0 00000100:00100000:2.0:1787787344.260686:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787344.260739:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694461056 00000100:00100000:2.0:1787787344.260747:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694461056 00000100:00100000:2.0:1787787344.261975:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694461440 00000100:00100000:2.0:1787787344.261985:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694461440 00000100:00100000:2.0:1787787344.262026:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694461184 00000100:00100000:2.0:1787787344.262029:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694461184 00000100:00100000:2.0:1787787344.262046:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787787344.262054:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe01e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1874630694461056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787344.262124:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe01e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1874630694461056:12345-0@lo:400:kworker.0 Request processed in 71us (1952us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787344.262132:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787787344.262147:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787787344.262153:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe00b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1874630694461440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787344.262181:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe00b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1874630694461440:12345-0@lo:400:kworker.0 Request processed in 28us (1765us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787344.262187:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787787344.262198:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787787344.262203:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe01a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874630694461184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787344.262234:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe01a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874630694461184:12345-0@lo:400:kworker.0 Request processed in 31us (1755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787344.262240:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787787344.262258:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694461568 00000100:00100000:2.0:1787787344.262262:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694461568 00000100:00100000:2.0:1787787344.262286:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694461312 00000100:00100000:2.0:1787787344.262290:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694461312 00000100:00100000:2.0:1787787344.262309:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787787344.262315:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694461568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787344.262345:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694461568:12345-0@lo:400:kworker.0 Request processed in 30us (2103us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787344.262351:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787787344.262360:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787787344.262371:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e45a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694461312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787344.262396:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e45a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694461312:12345-0@lo:400:kworker.0 Request processed in 26us (1708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787344.262401:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787787344.262417:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694460928 00000100:00100000:2.0:1787787344.262420:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694460928 00000100:00100000:2.0:1787787344.262456:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787787344.262462:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3292:x1874630694460928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787344.262489:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3292:x1874630694460928:12345-0@lo:400:kworker.0 Request processed in 27us (2118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787344.262495:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00080000:2.0:1787787344.263226:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787787344.263232:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787787344.263234:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787344.263283:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073c76fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694460928:0@lo:400:kworker.0 00000100:00100000:2.0:1787787344.263301:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1874630694461440:0@lo:400:kworker.0 00000100:00100000:2.0:1787787344.263313:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073c76cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874630694461056:0@lo:400:kworker.0 00010000:00080000:2.0:1787787344.263325:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0702fd6d00 x1874630694461568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787344.263336:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0702fd6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694461568:0@lo:400:kworker.0 00000100:00100000:2.0:1787787344.263461:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694461312:0@lo:400:kworker.0 00000100:00100000:2.0:1787787344.263473:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073c76c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1874630694461184:0@lo:400:kworker.0 00010000:00010000:3.0:1787787344.508676:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787344.766120:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694461696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787787344.766190:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787344.766467:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694461696 00000100:00100000:2.0:1787787344.766476:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694461696 00000100:00100000:2.0:1787787344.766563:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787787344.766573:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694461696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787787344.766608:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787344.770980:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694461696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4398us (4779us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787344.770995:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1787787344.774765:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0737e46580 x1874630694461696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787344.774800:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694461696:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787787345.532773:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787345.788815:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e48b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694461824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787345.788879:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787345.788988:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694461824 00000100:00100000:1.0:1787787345.788996:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694461824 00000100:00100000:1.0:1787787345.789040:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787787345.789049:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e46580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694461824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787787345.789082:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787787345.789127:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e46580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694461824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787345.789134:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787787345.789171:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e48b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694461824:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1787787346.493308:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787787346.556581:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787347.580650:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787347.938184:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787347.938322:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678699136 00000100:00100000:0.0:1787787347.938332:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678699136 00000100:00100000:0.0:1787787347.938388:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 273 00000100:00100000:0.0:1787787347.938398:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2345:x1874630678699136:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787787347.938504:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2345:x1874630678699136:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 106us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787347.938511:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 273 00000100:00100000:0.0:1787787347.944335:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787347.944422:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787347.944593:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787347.945477:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678699392 00000100:00100000:1.0:1787787347.945488:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678699392 00000100:00100000:1.0:1787787347.945562:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 60 00000100:00100000:1.0:1787787347.945583:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07059743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2344:x1874630678699392:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787787347.945664:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07059743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2344:x1874630678699392:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 93us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787347.945671:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 60 00000100:00100000:2.0:1787787347.947293:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678699264 00000100:00100000:2.0:1787787347.947306:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678699264 00000100:00100000:2.0:1787787347.947459:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678699520 00000100:00100000:2.0:1787787347.947464:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678699520 00000100:00100000:1.0:1787787347.947546:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 106 00000100:00100000:1.0:1787787347.947557:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0722250b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2344:x1874630678699264:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787787347.947647:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0722250b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2344:x1874630678699264:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 92us (3321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787347.947653:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 106 00000100:00100000:1.0:1787787347.947669:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 107 00000100:00100000:1.0:1787787347.947674:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2344:x1874630678699520:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787787347.947697:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2344:x1874630678699520:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 23us (3276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787347.947703:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 107 00000100:00080000:0.0:1787787347.947731:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787787347.947738:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787787348.606121:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787349.372683:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0702fd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694462336:0@lo:400:kworker.0 00000100:00100000:3.0:1787787349.372745:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787349.372802:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787787349.372810:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0702fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1874630694462208:0@lo:400:kworker.0 00000100:00100000:3.0:1787787349.372841:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787349.372845:0:10776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694462336 00000100:00100000:1.0:1787787349.372852:0:10776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694462336 00000100:00100000:3.0:1787787349.372885:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694462208 00000100:00100000:3.0:1787787349.372890:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694462208 00000100:00100000:3.0:1787787349.372926:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787787349.372934:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1874630694462208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787349.373193:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0702fd52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694461952:0@lo:400:kworker.0 00000100:00100000:0.0:1787787349.373228:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787349.373254:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0702fd4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1874630694462464:0@lo:400:kworker.0 00000100:00100000:0.0:1787787349.373273:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787349.373290:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787787349.373296:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0702fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1874630694462080:0@lo:400:kworker.0 00000100:00100000:0.0:1787787349.373328:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787349.373344:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0702fd70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694462592:0@lo:400:kworker.0 00000100:00100000:1.0:1787787349.373357:0:10776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787787349.373370:0:10776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694462336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787349.373378:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787349.373434:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694461952 00000100:00100000:0.0:1787787349.373458:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694461952 00000100:00100000:0.0:1787787349.373484:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787787349.373491:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07030da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3291:x1874630694461952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787349.373526:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07030da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3291:x1874630694461952:12345-0@lo:400:kworker.0 Request processed in 35us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787349.373533:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787787349.373561:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694462464 00000100:00100000:0.0:1787787349.373564:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694462464 00000100:00100000:0.0:1787787349.373580:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694462080 00000100:00100000:0.0:1787787349.373583:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694462080 00000100:00100000:0.0:1787787349.373609:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787787349.373615:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705977840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1874630694462464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787349.373684:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694462592 00000100:00100000:2.0:1787787349.373688:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694462592 00000100:00100000:2.0:1787787349.373712:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787787349.373718:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705975680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694462592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787349.373750:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705975680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694462592:12345-0@lo:400:kworker.0 Request processed in 32us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787349.373756:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787787349.373898:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705977840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1874630694462464:12345-0@lo:400:kworker.0 Request processed in 282us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787349.373904:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787787349.373918:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787787349.373924:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07059752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1874630694462080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787349.373952:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07059752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1874630694462080:12345-0@lo:400:kworker.0 Request processed in 28us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787349.373957:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:0.0:1787787349.373992:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787787349.373997:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787787349.373999:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787787349.374342:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1874630694462208:12345-0@lo:400:kworker.0 Request processed in 1407us (1500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787349.374351:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787787349.374548:0:10776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694462336:12345-0@lo:400:kworker.0 Request processed in 1181us (1801us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787349.374624:0:10776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787787349.374683:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0702fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1874630694462080:0@lo:400:kworker.0 00000100:00100000:3.0:1787787349.374694:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0702fd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1874630694462208:0@lo:400:kworker.0 00010000:00080000:1.0:1787787349.374716:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0702fd70c0 x1874630694462592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787349.374718:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0702fd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694462336:0@lo:400:kworker.0 00000100:00100000:1.0:1787787349.379068:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0702fd70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694462592:0@lo:400:kworker.0 00000100:00100000:1.0:1787787349.379105:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0702fd52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694461952:0@lo:400:kworker.0 00000100:00100000:1.0:1787787349.379122:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0702fd4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1874630694462464:0@lo:400:kworker.0 00010000:00010000:2.0:1787787349.629846:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787349.884720:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787787349.884743:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694462720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787787349.884808:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787349.885511:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694462720 00000100:00100000:2.0:1787787349.885521:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694462720 00000100:00100000:2.0:1787787349.885573:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787787349.885583:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694462720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787787349.885628:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787349.885846:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694462720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 263us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787349.885868:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1787787349.885953:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d073fe83480 x1874630694462720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787349.885972:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694462720:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787787350.654208:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787350.908741:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787787350.908764:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e48b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694462848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787787350.908842:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787350.909278:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694462848 00000100:00100000:2.0:1787787350.909286:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694462848 00000100:00100000:2.0:1787787350.909334:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787787350.909342:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07059770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694462848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787787350.909376:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787350.909432:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07059770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694462848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787350.909458:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787787350.909591:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e48b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694462848:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787787351.677179:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787352.700675:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787353.060251:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787353.060310:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787353.060466:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678699648 00000100:00100000:1.0:1787787353.060476:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678699648 00000100:00100000:1.0:1787787353.060530:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 275 00000100:00100000:1.0:1787787353.060539:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2345:x1874630678699648:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787787353.060613:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2345:x1874630678699648:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 75us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787353.060621:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 275 00000100:00100000:2.0:1787787353.060982:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678699776 00000100:00100000:2.0:1787787353.060987:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678699776 00000100:00100000:2.0:1787787353.061048:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 111 00000100:00100000:2.0:1787787353.061058:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2345:x1874630678699776:12345-192.168.206.10@tcp:400:kworker.0 00000100:00080000:1.0:1787787353.061080:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787353.061099:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2345:x1874630678699776:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 42us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787353.061108:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 111 00000100:00100000:3.0:1787787353.070590:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787353.070707:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678699904 00000100:00100000:2.0:1787787353.070719:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678699904 00000100:00100000:2.0:1787787353.070809:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 19 00000100:00100000:2.0:1787787353.070822:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2341:x1874630678699904:12345-192.168.206.10@tcp:9:kworker.0 00000020:00000080:2.0:1787787353.070864:0:6674:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b1236 00000100:00080000:2.0:1787787353.070875:0:6674:0:(import.c:65:import_set_state_nolock()) ffff9d073762e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787787353.070944:0:6674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1787787353.071257:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+2:2341:x1874630678699904:12345-192.168.206.10@tcp:9:kworker.0 Request processed in 438us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787353.071266:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 19 00000100:00080000:1.0:1787787353.071483:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787787353.071846:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787353.072785:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787353.072867:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678700032 00000100:00100000:3.0:1787787353.072876:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678700032 00000100:00100000:3.0:1787787353.072954:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 112 00000100:00100000:3.0:1787787353.072963:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2345:x1874630678700032:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787353.073031:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2345:x1874630678700032:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 69us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787353.073039:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 112 00000100:00080000:1.0:1787787353.073432:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787787353.724614:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787354.497355:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694462976:0@lo:400:kworker.0 00000100:00100000:1.0:1787787354.497422:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787354.497520:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694462976 00000100:00100000:1.0:1787787354.497527:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694462976 00000100:00100000:1.0:1787787354.497589:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1787787354.497605:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3291:x1874630694462976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787354.497654:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3291:x1874630694462976:12345-0@lo:400:kworker.0 Request processed in 50us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787354.497662:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1787787354.497705:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694462976:0@lo:400:kworker.0 00000100:00100000:1.0:1787787354.497740:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874630694463104:0@lo:400:kworker.0 00000100:00100000:1.0:1787787354.497780:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787354.497821:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694463104 00000100:00100000:1.0:1787787354.497826:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694463104 00000100:00100000:1.0:1787787354.497858:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787787354.497865:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07070912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1874630694463104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787354.497904:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07070912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1874630694463104:12345-0@lo:400:kworker.0 Request processed in 39us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787354.497911:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787787354.497944:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874630694463104:0@lo:400:kworker.0 00000100:00100000:1.0:1787787354.497983:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1874630694463232:0@lo:400:kworker.0 00000100:00100000:1.0:1787787354.498006:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787354.498034:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694463232 00000100:00100000:1.0:1787787354.498038:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694463232 00000100:00100000:1.0:1787787354.498067:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787787354.498074:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874630694463232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787354.498105:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874630694463232:12345-0@lo:400:kworker.0 Request processed in 33us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787354.498111:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:1.0:1787787354.498126:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787787354.498156:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1874630694463232:0@lo:400:kworker.0 00000100:00100000:1.0:1787787354.498184:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694463360:0@lo:400:kworker.0 00000100:00100000:1.0:1787787354.498208:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787354.498236:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694463360 00000100:00100000:1.0:1787787354.498240:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694463360 00000100:00100000:1.0:1787787354.498269:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787787354.498275:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707091e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694463360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787354.498307:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707091e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694463360:12345-0@lo:400:kworker.0 Request processed in 33us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787354.498314:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1787787354.498326:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787354.498343:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694463360:0@lo:400:kworker.0 00000100:00100000:1.0:1787787354.498370:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1874630694463488:0@lo:400:kworker.0 00000100:00100000:1.0:1787787354.498394:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787354.498418:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694463488 00000100:00100000:1.0:1787787354.498421:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694463488 00000100:00100000:1.0:1787787354.498470:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787787354.498476:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707090f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1874630694463488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787354.498508:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707090f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1874630694463488:12345-0@lo:400:kworker.0 Request processed in 33us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787354.498514:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:1.0:1787787354.498526:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787787354.498542:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1874630694463488:0@lo:400:kworker.0 00000100:00100000:1.0:1787787354.498586:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694463616:0@lo:400:kworker.0 00000100:00100000:1.0:1787787354.498609:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787354.498645:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694463616 00000100:00100000:1.0:1787787354.498649:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694463616 00000100:00100000:1.0:1787787354.498676:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787787354.498681:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07070930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694463616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787354.498714:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07070930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694463616:12345-0@lo:400:kworker.0 Request processed in 33us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787354.498721:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1787787354.498734:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787787354.498753:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0707093480 x1874630694463616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787354.498763:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694463616:0@lo:400:kworker.0 00000001:00100000:1.0:1787787354.579460:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c5599457-aa74-4a71-951f-faabe33e6ec7 00000020:00000080:1.0:1787787354.579469:0:6697:0:(genops.c:885:class_export_put()) final put ffff9d0707218000/c5599457-aa74-4a71-951f-faabe33e6ec7 00000020:00000080:1.0:1787787354.579500:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0707218000/c5599457-aa74-4a71-951f-faabe33e6ec7 for lustre-OST0000 00000020:00000080:1.0:1787787354.579678:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d073762e000 for lustre-OST0000 00010000:00010000:1.0:1787787354.751614:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787355.006836:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694463744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787787355.006915:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787355.007114:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694463744 00000100:00100000:3.0:1787787355.007122:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694463744 00000100:00100000:3.0:1787787355.007179:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787787355.007190:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694463744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787787355.007255:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787787355.007601:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694463744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 413us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787355.007611:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1787787355.007756:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d071b1dc000 x1874630694463744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787355.007778:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694463744:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787787355.777085:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787356.034382:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787787356.034402:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073c76c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694463872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787356.034474:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787356.034549:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694463872 00000100:00100000:2.0:1787787356.034565:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694463872 00000100:00100000:2.0:1787787356.034615:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787787356.034624:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073c76cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694463872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787787356.034654:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787356.034691:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073c76cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694463872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787356.034698:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1787787356.034721:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787356.034747:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073c76c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694463872:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1787787356.735794:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787787356.796610:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787357.824087:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787787357.933298:0:11837:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 19:35:56 (1787787356) 00000100:00100000:2.0:1787787358.199275:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787358.199314:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787358.199340:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787358.199366:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678700416 00000100:00100000:2.0:1787787358.199375:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678700416 00000100:00100000:0.0:1787787358.199497:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678700288 00000100:00100000:0.0:1787787358.199503:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678700288 00000100:00100000:0.0:1787787358.199564:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 116 00000100:00100000:0.0:1787787358.199576:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073c76fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2343:x1874630678700416:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787787358.199652:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073c76fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2343:x1874630678700416:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 78us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787358.199661:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 116 00000100:00100000:0.0:1787787358.199682:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 117 00000100:00100000:0.0:1787787358.199690:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073c76c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2343:x1874630678700288:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787787358.199718:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073c76c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2343:x1874630678700288:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 29us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787358.199725:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 117 00000100:00100000:3.0:1787787358.200986:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678700160 00000100:00100000:3.0:1787787358.200996:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678700160 00000100:00100000:3.0:1787787358.201109:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 277 00000100:00100000:3.0:1787787358.201118:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2343:x1874630678700160:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787358.201169:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2343:x1874630678700160:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 53us (1904us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787358.201176:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 277 00000100:00080000:0.0:1787787358.203164:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787787358.851845:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787359.614059:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694464000:0@lo:400:kworker.0 00000100:00100000:2.0:1787787359.614128:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787359.614191:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0708b5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1874630694464512:0@lo:400:kworker.0 00000100:00100000:2.0:1787787359.614238:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787359.614268:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787787359.614274:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0711577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1874630694464128:0@lo:400:kworker.0 00000100:00100000:2.0:1787787359.614297:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787359.614314:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0708b592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694464640:0@lo:400:kworker.0 00000100:00100000:2.0:1787787359.614346:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787359.614370:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0708b58f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1874630694464256:0@lo:400:kworker.0 00000100:00100000:2.0:1787787359.614392:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787359.614412:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787787359.614417:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0708b583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694464384:0@lo:400:kworker.0 00000100:00100000:2.0:1787787359.614464:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787359.614489:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694464512 00000100:00100000:2.0:1787787359.614495:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694464512 00000100:00100000:2.0:1787787359.614566:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694464128 00000100:00100000:2.0:1787787359.614570:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694464128 00000100:00100000:2.0:1787787359.614593:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694464256 00000100:00100000:2.0:1787787359.614596:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694464256 00000100:00100000:2.0:1787787359.614612:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787787359.614620:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fefda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1874630694464512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787359.614666:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fefda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1874630694464512:12345-0@lo:400:kworker.0 Request processed in 46us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787359.614674:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787787359.614689:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787787359.614695:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073feffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1874630694464128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787359.614718:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073feffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1874630694464128:12345-0@lo:400:kworker.0 Request processed in 24us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787359.614724:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787787359.614734:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787787359.614740:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fefe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874630694464256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787359.614766:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fefe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874630694464256:12345-0@lo:400:kworker.0 Request processed in 26us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787359.614772:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1787787359.614800:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787359.614826:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0708b58f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1874630694464256:0@lo:400:kworker.0 00000100:00100000:2.0:1787787359.614847:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0711577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1874630694464128:0@lo:400:kworker.0 00000100:00100000:2.0:1787787359.614856:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0708b5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1874630694464512:0@lo:400:kworker.0 00000100:00100000:0.0:1787787359.615470:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694464000 00000100:00100000:0.0:1787787359.615478:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694464000 00000100:00100000:0.0:1787787359.615521:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787787359.615529:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703094050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3291:x1874630694464000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787359.615598:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703094050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3291:x1874630694464000:12345-0@lo:400:kworker.0 Request processed in 70us (1471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787359.615605:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787787359.616548:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694464000:0@lo:400:kworker.0 00000100:00100000:1.0:1787787359.616832:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694464640 00000100:00100000:1.0:1787787359.616838:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694464640 00000100:00100000:1.0:1787787359.616891:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694464384 00000100:00100000:1.0:1787787359.616903:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694464384 00000100:00100000:1.0:1787787359.616929:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787787359.616937:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073feff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694464640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787359.616997:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073feff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694464640:12345-0@lo:400:kworker.0 Request processed in 62us (2650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787359.617004:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787787359.617018:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787787359.617023:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fefe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694464384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787359.617056:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fefe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694464384:12345-0@lo:400:kworker.0 Request processed in 33us (2618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787359.617062:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787787359.617096:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0708b583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694464384:0@lo:400:kworker.0 00010000:00080000:1.0:1787787359.617122:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0708b592c0 x1874630694464640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787787375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787359.617133:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0708b592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694464640:0@lo:400:kworker.0 00000100:00080000:0.0:1787787359.617427:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787787359.617432:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787787359.869920:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787359.919312:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787359.919411:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678700544 00000100:00100000:2.0:1787787359.919420:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678700544 00000100:00100000:2.0:1787787359.919504:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 32 00000100:00100000:2.0:1787787359.919523:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707093c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+5:10230:x1874630678700544:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787787359.919551:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787359.919572:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b1301 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35078 expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787359.919656:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1308 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787359.919670:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1308 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787359.919683:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1308 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787359.919866:0:9687:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787787359.919870:0:9687:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787787359.919959:0:9687:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1308 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787359.919992:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b1301 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35078 expref: 7 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787359.920188:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1308 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35078 expref: 6 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787359.920196:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d07078d0100) 00010000:00010000:2.0:1787787359.920199:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787787359.920202:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd39200, rc 0) 00000100:00100000:2.0:1787787359.920269:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707093c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+6:10230:x1874630678700544:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 748us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787359.920277:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 32 00000100:00100000:0.0:1787787359.936654:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787359.936783:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678700672 00000100:00100000:2.0:1787787359.936793:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678700672 00000100:00100000:2.0:1787787359.936851:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 33 00000100:00100000:2.0:1787787359.936860:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0708b5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+6:10231:x1874630678700672:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787787359.936878:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787359.936898:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b130f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3507f expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787359.936971:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b1316 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787359.936984:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b1316 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787359.936995:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b1316 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787359.937022:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b131d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787359.937030:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b131d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787359.937037:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b131d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787359.937410:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39a00/0xdeb1953cba4b1324 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787359.937646:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39a00/0xdeb1953cba4b1324 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787359.937655:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39a00/0xdeb1953cba4b1324 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787359.937747:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787787359.937751:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787787359.937828:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39a00/0xdeb1953cba4b1324 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787359.937839:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b1316 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787359.937845:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b1316 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787359.937852:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b1316 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787359.937867:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd38200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787359.937872:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b1316 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787359.937880:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b1316 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787359.937893:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d07078d0100) 00010000:00010000:2.0:1787787359.937896:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787359.937900:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b1316 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787359.937906:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b1316 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787359.937918:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b131d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787359.937923:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b131d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787359.938596:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b131d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787359.938602:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd38600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787359.938605:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b131d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787359.938612:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b131d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787359.938635:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9d07078d0e00) 00010000:00010000:2.0:1787787359.938638:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787359.938641:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b131d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787359.938647:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b131d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787359.938685:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b130f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3507f expref: 8 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787359.938699:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39a00/0xdeb1953cba4b1324 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3507f expref: 7 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787359.938706:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d07078d0800) 00010000:00010000:2.0:1787787359.938709:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787787359.938711:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd39a00, rc 0) 00000100:00100000:2.0:1787787359.938784:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0708b5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+7:10231:x1874630678700672:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 1924us (2141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787359.938791:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 33 00000100:00100000:2.0:1787787359.951945:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787359.952355:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678700928 00000100:00100000:3.0:1787787359.952365:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678700928 00000100:00100000:3.0:1787787359.952433:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 34 00000100:00100000:3.0:1787787359.952460:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fefc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+7:10231:x1874630678700928:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787787359.952479:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787359.952499:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b132b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35086 expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787359.952576:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b1332 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787359.952589:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b1332 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787359.952599:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b1332 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787359.952648:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1339 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787359.952657:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1339 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787359.952664:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1339 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787359.957547:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771400/0xdeb1953cba4b1340 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787359.957569:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771400/0xdeb1953cba4b1340 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787359.957581:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771400/0xdeb1953cba4b1340 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787359.957593:0:9687:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787787359.957812:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b1332 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787359.957821:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b1332 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787359.957828:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b1332 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787359.957834:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708770000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787359.957838:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b1332 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787359.957856:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b1332 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787359.957869:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d07078d0800) 00010000:00010000:3.0:1787787359.957872:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787359.957876:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b1332 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787359.957882:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b1332 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787359.957893:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1339 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787359.957900:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1339 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787359.957906:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1339 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787359.957910:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708770200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787359.957913:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1339 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787359.961169:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1339 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787359.961355:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9d071b71db00) 00010000:00010000:3.0:1787787359.961359:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787359.961364:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1339 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787359.961390:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1339 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787359.963876:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b132b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35086 expref: 10 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787359.963903:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771400/0xdeb1953cba4b1340 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35086 expref: 9 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787359.963912:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d071b71da00) 00010000:00010000:3.0:1787787359.963914:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787359.963928:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708771400, rc 0) 00000100:00100000:3.0:1787787359.963990:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fefc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+9:10231:x1874630678700928:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 11531us (12053us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787787359.963999:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 34 00000100:00100000:1.0:1787787359.970714:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787359.970799:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678701056 00000100:00100000:0.0:1787787359.970817:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678701056 00000100:00100000:0.0:1787787359.970875:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 35 00000100:00100000:0.0:1787787359.970885:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707093840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+9:10231:x1874630678701056:12345-192.168.206.10@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787787359.971004:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707093840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+9:10231:x1874630678701056:12345-192.168.206.10@tcp:59:lhsmtool_posix.0 Request processed in 120us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787359.971012:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 35 00000100:00100000:0.0:1787787360.129416:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0708b58b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694464768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787360.129523:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787360.131224:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694464768 00000100:00100000:2.0:1787787360.131239:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694464768 00000100:00100000:2.0:1787787360.131302:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787787360.131313:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0708b5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694464768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787787360.131352:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787360.131454:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0708b5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694464768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (1912us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787360.131472:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1787787360.131517:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0708b58b40 x1874630694464768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787360.131545:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0708b58b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694464768:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1787787360.833257:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787787360.899779:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787361.148702:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787787361.148723:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fefcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694464896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787787361.148787:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787361.148893:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694464896 00000100:00100000:2.0:1787787361.148901:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694464896 00000100:00100000:2.0:1787787361.148973:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787787361.148982:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707092580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694464896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787787361.149014:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787361.149072:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707092580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694464896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787361.149080:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787787361.149123:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fefcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694464896:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787787361.149350:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787787361.840022:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787361.846090:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678701184 00000100:00100000:2.0:1787787361.846104:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678701184 00000100:00100000:2.0:1787787361.846191:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 36 00000100:00100000:2.0:1787787361.846203:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+9:10274:x1874630678701184:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787787361.846223:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787361.846243:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b134e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3508d expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787361.846302:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1355 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787361.846316:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1355 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787361.846336:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1355 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787361.846350:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b135c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787361.846357:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b135c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787361.846363:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b135c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787361.846638:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1355 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787361.846647:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1355 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787361.846653:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1355 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787361.846659:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39e00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787361.846662:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1355 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787361.846669:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1355 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787361.846680:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d07078d0100) 00010000:00010000:2.0:1787787361.846683:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787361.846687:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1355 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787361.846699:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1355 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787361.846710:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b135c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787361.846716:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b135c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787361.846721:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b135c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787361.846725:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787361.846728:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b135c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787361.846733:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b135c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787361.846740:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9d07078d0600) 00010000:00010000:2.0:1787787361.846742:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787361.846744:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b135c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787361.846749:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b135c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787361.846778:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b134e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3508d expref: 10 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787361.846799:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d07078d0100) 00010000:00010000:2.0:1787787361.846802:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787361.846806:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b134e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3508d expref: 10 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787361.846816:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd38a00, rc 0) 00000100:00100000:2.0:1787787361.846878:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+9:10274:x1874630678701184:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 678us (6865us total) trans 0 rc 301/301 00000100:00100000:2.0:1787787361.846886:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 36 00000100:00080000:0.0:1787787361.847230:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787361.857335:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787361.857397:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678701440 00000100:00100000:1.0:1787787361.857405:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678701440 00000100:00100000:1.0:1787787361.857470:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 37 00000100:00100000:1.0:1787787361.857478:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fefcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+9:10274:x1874630678701440:12345-192.168.206.10@tcp:36:lfs.0 00010000:00010000:1.0:1787787361.857534:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787361.857564:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1308 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35078 expref: 9 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787361.857581:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d07078d0100) 00010000:00010000:1.0:1787787361.857591:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787787361.857841:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b1363 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787361.857854:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b1363 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787361.857863:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b1363 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787361.857874:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b136a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787361.857881:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b136a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787361.857888:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b136a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787361.863852:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787787361.863868:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b1363 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787361.863878:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b1363 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787361.863885:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b1363 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787361.865057:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212aa00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787361.865064:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b1363 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787361.865073:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b1363 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787361.865089:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d07114ac900) 00010000:00010000:1.0:1787787361.865092:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787361.865097:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b1363 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787361.865102:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b1363 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787787361.865125:0:5820:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c779334 reply state 000000007ba79550 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b136a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787361.865134:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787787361.866114:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fefcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+10:10274:x1874630678701440:12345-192.168.206.10@tcp:36:lfs.0 Request processed in 8629us (8778us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787787361.866124:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 37 00010000:00010000:0.0:1787787361.869835:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b136a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787361.869850:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b136a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787361.869858:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b136a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787361.869866:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212b000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787361.869871:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b136a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787361.869879:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b136a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787361.869910:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9d07114acc00) 00010000:00010000:0.0:1787787361.869913:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787361.869918:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b136a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787361.869925:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b136a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787361.917001:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787361.966563:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787361.974369:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678701568 00000100:00100000:0.0:1787787361.974383:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678701568 00000100:00100000:3.0:1787787361.974582:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 38 00000100:00100000:3.0:1787787361.974597:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fefd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+9:10282:x1874630678701568:12345-192.168.206.10@tcp:101:lctl.0 00010000:00010000:3.0:1787787361.974622:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787361.974645:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b1371 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35094 expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787361.974710:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1378 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787361.974723:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1378 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787361.974748:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1378 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787361.974804:0:9687:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787787361.974807:0:9687:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787787361.974847:0:9687:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1378 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787361.974870:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b1371 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35094 expref: 11 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787361.974887:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1378 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35094 expref: 10 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787361.974895:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:3.0:1787787361.974897:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787787361.974900:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708770600, rc 0) 00000100:00100000:3.0:1787787361.974971:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fefd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+10:10282:x1874630678701568:12345-192.168.206.10@tcp:101:lctl.0 Request processed in 379us (8418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787361.974979:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 38 00000100:00100000:1.0:1787787362.051378:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787362.051549:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678701696 00000100:00100000:2.0:1787787362.051558:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678701696 00000100:00100000:2.0:1787787362.051724:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 39 00000100:00100000:2.0:1787787362.051733:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707090780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+10:10288:x1874630678701696:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:2.0:1787787362.051752:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787362.051772:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b137f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3509b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.051833:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1386 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.051847:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1386 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.051858:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1386 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.051890:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b138d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.051898:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b138d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.052014:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b138d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.052119:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39600/0xdeb1953cba4b1394 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.052127:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39600/0xdeb1953cba4b1394 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.052135:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39600/0xdeb1953cba4b1394 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787362.052293:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787787362.052297:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787787362.052343:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39600/0xdeb1953cba4b1394 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.052355:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1386 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.052362:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1386 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.052369:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1386 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.052386:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787362.052390:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1386 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.052398:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1386 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.052412:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:2.0:1787787362.052415:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787362.052419:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1386 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.052426:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1386 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.052511:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b138d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.052518:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b138d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.052533:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b138d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.052537:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39e00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787362.052540:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b138d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.052546:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b138d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.052566:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9d07078d0600) 00010000:00010000:2.0:1787787362.052789:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787362.052794:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b138d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.052801:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b138d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.052836:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b137f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3509b expref: 12 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.052849:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39600/0xdeb1953cba4b1394 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3509b expref: 11 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.052856:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d07078d0f00) 00010000:00010000:2.0:1787787362.052858:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787787362.052860:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd39600, rc 0) 00000100:00100000:3.0:1787787362.053844:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707090780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+11:10288:x1874630678701696:12345-192.168.206.10@tcp:101:bash.0 Request processed in 2104us (2468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787362.053855:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 39 00000100:00100000:1.0:1787787362.058096:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787362.058175:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678701952 00000100:00100000:0.0:1787787362.058183:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678701952 00000100:00100000:0.0:1787787362.058235:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 40 00000100:00100000:0.0:1787787362.058243:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707090b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+11:10288:x1874630678701952:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:0.0:1787787362.058262:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787362.058281:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141ee00/0xdeb1953cba4b139b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c350a2 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.058391:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e000/0xdeb1953cba4b13a2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.058404:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e000/0xdeb1953cba4b13a2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.058415:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e000/0xdeb1953cba4b13a2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.058428:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141f600/0xdeb1953cba4b13a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.058665:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141f600/0xdeb1953cba4b13a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.058673:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141f600/0xdeb1953cba4b13a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787787362.059254:0:5819:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1787787362.059408:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b13b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.059419:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b13b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.059427:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b13b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.060072:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e000/0xdeb1953cba4b13a2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.060082:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e000/0xdeb1953cba4b13a2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.060089:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e000/0xdeb1953cba4b13a2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.060095:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d070141e000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787362.060098:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e000/0xdeb1953cba4b13a2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.060106:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e000/0xdeb1953cba4b13a2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.060131:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d07078d0f00) 00010000:00010000:0.0:1787787362.060133:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787362.060138:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e000/0xdeb1953cba4b13a2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.060144:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141e000/0xdeb1953cba4b13a2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787787362.060156:0:5819:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000060e8a198 reply state 00000000bc9a804a transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141f600/0xdeb1953cba4b13a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787362.060164:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787787362.060194:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141ee00/0xdeb1953cba4b139b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350a2 expref: 14 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.060206:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b13b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350a2 expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.060214:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07096a0d00) 00010000:00010000:0.0:1787787362.060216:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787787362.060218:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d07059fc400, rc 0) 00000100:00100000:0.0:1787787362.060289:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707090b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+14:10288:x1874630678701952:12345-192.168.206.10@tcp:101:bash.0 Request processed in 2046us (2201us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787787362.060296:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 40 00010000:00010000:0.0:1787787362.062270:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141f600/0xdeb1953cba4b13a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.062286:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141f600/0xdeb1953cba4b13a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.062308:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141f600/0xdeb1953cba4b13a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.062314:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d070141f600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787362.062317:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141f600/0xdeb1953cba4b13a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.062325:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141f600/0xdeb1953cba4b13a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.062339:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d07096a0800) 00010000:00010000:0.0:1787787362.062342:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787362.062346:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141f600/0xdeb1953cba4b13a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.062352:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d070141f600/0xdeb1953cba4b13a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787362.069281:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787362.073348:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678702080 00000100:00100000:2.0:1787787362.073363:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678702080 00000100:00100000:2.0:1787787362.073410:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 20 00000100:00100000:2.0:1787787362.073419:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707091680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2341:x1874630678702080:12345-192.168.206.10@tcp:8:bash.0 00010000:00080000:2.0:1787787362.073464:0:6673:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c5599457-aa74-4a71-951f-faabe33e6ec7@192.168.206.10@tcp t0 exp 0000000000000000 cur 274 last 0 00000020:00000080:2.0:1787787362.073507:0:6673:0:(genops.c:1385:class_connect()) connect: client c5599457-aa74-4a71-951f-faabe33e6ec7, cookie 0xdeb1953cba4b13be 00002000:00100000:2.0:1787787362.073518:0:6673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c5599457-aa74-4a71-951f-faabe33e6ec7/ffff9d0734165800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113934 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787787362.073551:0:6673:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787787362.073800:0:6673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787787362.073845:0:6673:0:(import.c:65:import_set_state_nolock()) ffff9d0734166000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787362.073931:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707091680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2341:x1874630678702080:12345-192.168.206.10@tcp:8:bash.0 Request processed in 510us (4658us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787362.073940:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 20 00000100:00100000:3.0:1787787362.077018:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787362.077152:0:10776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678702208 00000100:00100000:1.0:1787787362.077162:0:10776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678702208 00000100:00100000:1.0:1787787362.077237:0:10776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 21 00000100:00100000:1.0:1787787362.077247:0:10776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+6:0:x1874630678702208:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:1.0:1787787362.077277:0:10776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1787787362.077287:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787787362.077299:0:10776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8bfab79/0xdeb1953cba4b13c5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c350a9 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787787362.077325:0:10776:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787787362.077343:0:10776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=274s v=(0 0) 00010000:00010000:1.0:1787787362.077347:0:10776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787362.077357:0:10776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8bfab79/0xdeb1953cba4b13c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350a9 expref: 7 pid: 10776 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787362.077377:0:10776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c8bfab79/0xdeb1953cba4b13c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350a9 expref: 7 pid: 10776 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787362.077390:0:10776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d072212b000, rc 0) 00000100:00100000:1.0:1787787362.077476:0:10776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+7:0:x1874630678702208:12345-192.168.206.10@tcp:101:bash.0 Request processed in 230us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787362.077483:0:10776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 21 00000100:00100000:3.0:1787787362.080567:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787362.080755:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678702336 00000100:00100000:2.0:1787787362.080765:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678702336 00000100:00100000:2.0:1787787362.080823:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 22 00000100:00100000:2.0:1787787362.080834:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+7:10288:x1874630678702336:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:2.0:1787787362.080850:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787362.080870:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6872a14/0xdeb1953cba4b13cc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c350b0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.080897:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8bfab79/0xdeb1953cba4b13c5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350a9 expref: 8 pid: 10776 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.080907:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787362.080919:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787362.080925:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6872a14/0xdeb1953cba4b13cc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350b0 expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.080956:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c8bfab79/0xdeb1953cba4b13c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350a9 expref: 8 pid: 10776 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.080970:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c8bfab79/0xdeb1953cba4b13c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350a9 expref: 8 pid: 10776 timeout: 374 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787362.080985:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fefc3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6673:1874630694465024:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787787362.081091:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073476e840 going to sleep for 11 seconds 00000100:00100000:1.0:1787787362.088586:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fefc3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6673:1874630694465024:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787787362.088632:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b6872a14/0xdeb1953cba4b13cc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350b0 expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787362.088653:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd39e00, rc 0) 00000100:00100000:1.0:1787787362.088717:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+8:10288:x1874630678702336:12345-192.168.206.10@tcp:101:bash.0 Request processed in 7885us (8158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787362.088728:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 22 00000100:00100000:3.0:1787787362.088779:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787362.089193:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678702464 00000100:00100000:1.0:1787787362.089200:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678702464 00010000:00010000:1.0:1787787362.089227:0:8496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c8bfab79/0xdeb1953cba4b13c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350a9 expref: 8 pid: 10776 timeout: 374 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787362.089261:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 35 00000100:00100000:1.0:1787787362.089270:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+8:2345:x1874630678702464:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787787362.089291:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787362.089310:0:8496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c8bfab79/0xdeb1953cba4b13c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350a9 expref: 8 pid: 10776 timeout: 374 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787362.089324:0:8496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c8bfab79/0xdeb1953cba4b13c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350a9 expref: 8 pid: 10776 timeout: 374 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787362.089345:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8bfab79/0xdeb1953cba4b13c5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350a9 expref: 8 pid: 10776 timeout: 374 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787362.089359:0:8496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787362.089363:0:8496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787362.089371:0:8496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6872a14/0xdeb1953cba4b13cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350b0 expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787362.089381:0:8496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6872a14/0xdeb1953cba4b13cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350b0 expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787362.089411:0:8496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b6872a14/0xdeb1953cba4b13cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350b0 expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787362.089432:0:8496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07070903c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8496:1874630694465152:192.168.206.10@tcp:105: 00000100:00100000:1.0:1787787362.089556:0:8496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0706ba8540 going to sleep for 11 seconds 00000100:00100000:1.0:1787787362.095352:0:8496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07070903c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8496:1874630694465152:192.168.206.10@tcp:105: 00010000:00010000:1.0:1787787362.095378:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787362.095459:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2345:x1874630678702464:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 6189us (6680us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787362.095470:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 35 00000100:00100000:0.0:1787787362.097554:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787362.097824:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678702720 00000100:00100000:3.0:1787787362.097845:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678702720 00000100:00100000:3.0:1787787362.097906:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:3.0:1787787362.097925:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0708b583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+13:10288:x1874630678702720:12345-192.168.206.10@tcp:35:bash.0 00000100:00100000:3.0:1787787362.098264:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0708b583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+14:10288:x1874630678702720:12345-192.168.206.10@tcp:35:bash.0 Request processed in 340us (716us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787787362.098273:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:2.0:1787787362.203510:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787362.203615:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678702976 00000100:00100000:1.0:1787787362.203625:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678702976 00000100:00100000:1.0:1787787362.203682:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 41 00000100:00100000:1.0:1787787362.203691:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fefed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+14:10298:x1874630678702976:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787787362.203714:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787362.203734:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b800/0xdeb1953cba4b13d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c350b7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787362.203835:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787787362.203959:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b800/0xdeb1953cba4b13d3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350b7 expref: 16 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787362.203975:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:1.0:1787787362.203977:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787787362.203983:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b800/0xdeb1953cba4b13d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350b7 expref: 16 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787362.203996:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d072212b800, rc 0) 00000100:00100000:1.0:1787787362.204068:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fefed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+15:10298:x1874630678702976:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 378us (566us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1787787362.204075:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 41 00000100:00100000:1.0:1787787362.206983:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787362.207096:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678703232 00000100:00100000:3.0:1787787362.207105:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678703232 00000100:00100000:3.0:1787787362.207158:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:3.0:1787787362.207174:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07070903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+15:10298:x1874630678703232:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:3.0:1787787362.207412:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07070903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+16:10298:x1874630678703232:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 244us (435us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787787362.207419:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:0.0:1787787362.288090:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787362.288485:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678703360 00000100:00100000:3.0:1787787362.288495:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678703360 00000100:00100000:3.0:1787787362.288626:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 42 00000100:00100000:3.0:1787787362.288635:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0708b5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+16:10304:x1874630678703360:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787787362.288656:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787362.288686:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b13e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c350be expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.288935:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b13e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.288950:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b13e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.288961:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b13e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787362.289031:0:9687:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787787362.289035:0:9687:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787787362.289057:0:9687:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b13e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.289092:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b13e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350be expref: 18 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.289111:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b13e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350be expref: 17 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.289118:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d07078d0f00) 00010000:00010000:3.0:1787787362.289121:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787787362.289124:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708770200, rc 0) 00000100:00100000:3.0:1787787362.289198:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0708b5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+17:10304:x1874630678703360:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 563us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787362.289206:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 42 00000100:00100000:0.0:1787787362.301158:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787362.301483:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678703616 00000100:00100000:1.0:1787787362.301496:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678703616 00000100:00100000:1.0:1787787362.301589:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 43 00000100:00100000:1.0:1787787362.301601:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0708b58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+17:10304:x1874630678703616:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787787362.301628:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787362.301656:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b13ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c350c5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787362.301785:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ac00/0xdeb1953cba4b13f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787362.301802:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ac00/0xdeb1953cba4b13f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787362.301817:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ac00/0xdeb1953cba4b13f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787362.301830:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787787362.302009:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b13ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350c5 expref: 20 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787362.302031:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ac00/0xdeb1953cba4b13f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350c5 expref: 19 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787362.302041:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07096a0d00) 00010000:00010000:1.0:1787787362.302060:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787787362.302065:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d072212ac00, rc 0) 00000100:00100000:1.0:1787787362.302146:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0708b58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+19:10304:x1874630678703616:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 547us (1003us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787787362.302154:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 43 00000100:00100000:1.0:1787787362.310289:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787362.310427:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678703744 00000100:00100000:3.0:1787787362.310476:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678703744 00000100:00100000:3.0:1787787362.310554:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:3.0:1787787362.310566:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707092d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+19:2343:x1874630678703744:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787362.310585:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787362.310620:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ac00/0xdeb1953cba4b13f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350c5 expref: 19 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.310643:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07096a0d00) 00010000:00010000:3.0:1787787362.310665:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787362.310738:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707092d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+18:2343:x1874630678703744:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 174us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787362.310747:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:0.0:1787787362.320926:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787362.321101:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678704000 00000100:00100000:2.0:1787787362.321111:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678704000 00000100:00100000:2.0:1787787362.321170:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 44 00000100:00100000:2.0:1787787362.321181:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0708b592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+18:10304:x1874630678704000:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787787362.321205:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787362.321225:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1404 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c350cc expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.321319:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b140b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.321336:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b140b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.321349:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b140b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787362.321361:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787787362.321545:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1404 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350cc expref: 21 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.321565:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b140b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350cc expref: 20 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.321574:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07096a0d00) 00010000:00010000:2.0:1787787362.321577:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787787362.321580:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd38800, rc 0) 00000100:00100000:2.0:1787787362.321654:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0708b592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+20:10304:x1874630678704000:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 475us (737us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787787362.321663:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 44 00000100:00100000:2.0:1787787362.333881:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787362.333998:0:10776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678704128 00000100:00100000:1.0:1787787362.334009:0:10776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678704128 00000100:00100000:1.0:1787787362.334080:0:10776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 23 00000100:00100000:1.0:1787787362.334091:0:10776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fefe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2344:x1874630678704128:12345-192.168.206.10@tcp:1:lfs.0 00010000:00010000:1.0:1787787362.334144:0:10776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004feaad95/0xdeb1953cba4b1419 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787362.334180:0:10776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6872a14/0xdeb1953cba4b13cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350b0 expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787362.334190:0:10776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787362.334195:0:10776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787787362.334208:0:10776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004feaad95/0xdeb1953cba4b1419 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787362.334251:0:10776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b6872a14/0xdeb1953cba4b13cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350b0 expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787362.334267:0:10776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b6872a14/0xdeb1953cba4b13cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350b0 expref: 7 pid: 6673 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787362.334308:0:10776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07070921c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10776:1874630694465280:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787787362.334697:0:10776:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0706ba8540 going to sleep for 11 seconds 00000100:00100000:1.0:1787787362.338716:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787362.339160:0:10776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07070921c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10776:1874630694465280:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787787362.339566:0:10776:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004feaad95/0xdeb1953cba4b1419 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787362.340324:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678704256 00000100:00100000:3.0:1787787362.340338:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678704256 00002000:00100000:3.0:1787787362.340385:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9d0707092940 x1874630678704256/t0(0) o4->c5599457-aa74-4a71-951f-faabe33e6ec7@192.168.206.10@tcp:223/0 lens 504/0 e 0 to 0 dl 1787787373 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787787362.340396:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d0707092940 with x1874630678704256 ext(0->12) 00010000:00010000:3.0:1787787362.340405:0:6678:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b6872a14/0xdeb1953cba4b13cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350b0 expref: 8 pid: 6673 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.340422:0:6678:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b6872a14/0xdeb1953cba4b13cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350b0 expref: 8 pid: 6673 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787787362.340430:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d0707092940 00000100:00100000:3.0:1787787362.340495:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:3.0:1787787362.340506:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707092940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+8:2344:x1874630678704256:12345-192.168.206.10@tcp:4:lfs.0 00000001:00100000:2.0:1787787362.387040:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c5599457-aa74-4a71-951f-faabe33e6ec7 00000100:00100000:3.0:1787787362.387730:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707092940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+9:2344:x1874630678704256:12345-192.168.206.10@tcp:4:lfs.0 Request processed in 47219us (49017us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787787362.387880:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 0 00002000:00100000:3.0:1787787362.387893:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9d0707092940 x1874630678704256/t4294967299(0) o4->c5599457-aa74-4a71-951f-faabe33e6ec7@192.168.206.10@tcp:223/0 lens 504/448 e 0 to 0 dl 1787787373 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787787362.387903:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d0707092940 with x1874630678704256 ext(0->12) 00010000:00010000:3.0:1787787362.387913:0:6678:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b6872a14/0xdeb1953cba4b13cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350b0 expref: 9 pid: 6673 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.387941:0:6678:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b6872a14/0xdeb1953cba4b13cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350b0 expref: 9 pid: 6673 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787787362.387950:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d0707092940 00000100:00100000:0.0:1787787362.392877:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787362.393024:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678704384 00000100:00100000:3.0:1787787362.393034:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678704384 00010000:00010000:3.0:1787787362.393073:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b6872a14/0xdeb1953cba4b13cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350b0 expref: 9 pid: 6673 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787362.393105:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 36 00000100:00100000:3.0:1787787362.393113:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0708b58b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+9:2343:x1874630678704384:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787362.393139:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787787362.393157:0:5805:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787787362.393160:0:5805:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787787361 00002000:00010000:3.0:1787787362.393163:0:5805:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787787362 00002000:00010000:3.0:1787787362.393165:0:5805:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787787361 00010000:00010000:3.0:1787787362.393171:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b6872a14/0xdeb1953cba4b13cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350b0 expref: 9 pid: 6673 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.393190:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b6872a14/0xdeb1953cba4b13cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350b0 expref: 9 pid: 6673 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.393216:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6872a14/0xdeb1953cba4b13cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350b0 expref: 9 pid: 6673 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.393251:0:5805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787787362.393254:0:5805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787787362.393260:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004feaad95/0xdeb1953cba4b1419 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.393269:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004feaad95/0xdeb1953cba4b1419 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.393295:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787362.393353:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0708b58b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+8:2343:x1874630678704384:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 240us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787362.393360:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 36 00010000:00010000:2.0:1787787362.394603:0:10776:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004feaad95/0xdeb1953cba4b1419 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.394618:0:10776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004feaad95/0xdeb1953cba4b1419 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.394648:0:10776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004feaad95/0xdeb1953cba4b1419 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.394656:0:10776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004feaad95/0xdeb1953cba4b1419 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.394663:0:10776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004feaad95/0xdeb1953cba4b1419 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.394670:0:10776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212ba00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:2.0:1787787362.394674:0:10776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004feaad95/0xdeb1953cba4b1419 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.394695:0:10776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004feaad95/0xdeb1953cba4b1419 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.394713:0:10776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004feaad95/0xdeb1953cba4b1419 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.394720:0:10776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004feaad95/0xdeb1953cba4b1419 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787362.394976:0:10776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fefe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2344:x1874630678704128:12345-192.168.206.10@tcp:1:lfs.0 Request processed in 60883us (61105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787362.394987:0:10776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 23 00000100:00100000:0.0:1787787362.399666:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787362.399892:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678704640 00000100:00100000:3.0:1787787362.399902:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678704640 00000100:00100000:3.0:1787787362.399993:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:3.0:1787787362.400012:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073475fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+20:10304:x1874630678704640:12345-192.168.206.10@tcp:35:lfs.0 00000004:00010000:3.0:1787787362.400072:0:5823:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b140b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350cc expref: 20 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787787362.400371:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1787787362.400430:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1787787362.401301:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1787787362.401363:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b1420 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.401381:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b13b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350a2 expref: 24 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.401397:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b1420 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.401430:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b13b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350a2 expref: 24 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.401543:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b13b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350a2 expref: 24 pid: 5819 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787362.401558:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0702fd6940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5823:1874630694465408:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787787362.401658:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0706224a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787787362.409787:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787362.409839:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678704768 00000100:00100000:2.0:1787787362.409848:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678704768 00010000:00010000:2.0:1787787362.409888:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b13b0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350a2 expref: 25 pid: 5819 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787362.409932:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 37 00000100:00100000:2.0:1787787362.409941:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707091a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+25:2345:x1874630678704768:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787362.409954:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787362.409961:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b13b0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350a2 expref: 25 pid: 5819 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.409974:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b13b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350a2 expref: 25 pid: 5819 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.410012:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07096a0d00) 00010000:00010000:2.0:1787787362.410017:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b1420 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.410026:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b1420 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.410033:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b1420 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.410051:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787362.410109:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707091a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+25:2345:x1874630678704768:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 168us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787362.410116:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 37 00010000:00010000:3.0:1787787362.411373:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b13b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350a2 expref: 24 pid: 5819 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787362.411399:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0702fd6940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5823:1874630694465408:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787787362.411536:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b1420 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.411548:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b1420 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.411553:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b1420 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787787362.411682:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1787787362.411877:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1787787362.418067:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0702fd6940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5823:1874630694465536:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787787362.418177:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787362.418217:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0706224540 going to sleep for 11 seconds 00000100:00100000:1.0:1787787362.418372:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694465536 00000100:00100000:1.0:1787787362.418380:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694465536 00000100:00100000:1.0:1787787362.418478:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787787362.418488:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5823:x1874630694465536:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787787362.418592:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5823:x1874630694465536:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 106us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787362.418600:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787787362.418665:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0702fd6940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5823:1874630694465536:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:0.0:1787787362.418760:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1787787362.419325:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1787787362.419412:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0702fd6940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5823:1874630694465664:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787787362.419486:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787362.419514:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0706224a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787787362.419548:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694465664 00000100:00100000:1.0:1787787362.419554:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694465664 00000100:00100000:1.0:1787787362.419590:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787787362.419598:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5823:x1874630694465664:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787787362.419753:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5823:x1874630694465664:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 155us (265us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787787362.419760:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787787362.420184:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0702fd6940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5823:1874630694465664:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787787362.420240:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1787787362.420284:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b1420 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.420295:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b1420 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.420303:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b1420 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.420309:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708770000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787362.420313:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b1420 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.420320:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b1420 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.420335:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07096a0d00) 00010000:00010000:3.0:1787787362.420338:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787787362.420343:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b1420 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.420365:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b1420 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787787362.420602:0:5823:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787787362.420828:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1787787362.420840:0:5823:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 274647401184ns, next at 275647399273ns, rc = 0 00000001:00080000:3.0:1787787362.420847:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1787787362.420883:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07096a0d00) 00010000:00010000:3.0:1787787362.420886:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787787362.420893:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b140b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350cc expref: 28 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787362.422690:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073475fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+27:10304:x1874630678704640:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 22672us (23023us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1787787362.422702:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 8 00000020:00080000:3.0:1787787362.422707:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787787362.427131:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787362.427296:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678704896 00000100:00100000:0.0:1787787362.427307:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678704896 00000100:00100000:0.0:1787787362.427365:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 45 00000100:00100000:0.0:1787787362.427374:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07070921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+27:10304:x1874630678704896:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787787362.427415:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787362.427473:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd800/0xdeb1953cba4b1427 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c350d3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.427542:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd800/0xdeb1953cba4b1427 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350d3 expref: 28 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.427557:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd800/0xdeb1953cba4b1427 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350d3 expref: 28 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.427576:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07096a0400) 00010000:00010000:0.0:1787787362.427579:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787787362.427583:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d07059fd800, rc 0) 00000100:00100000:0.0:1787787362.427635:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07070921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+28:10304:x1874630678704896:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 262us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787362.427643:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 45 00000100:00100000:0.0:1787787362.434665:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787362.434763:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678705152 00000100:00100000:2.0:1787787362.434773:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678705152 00000100:00100000:2.0:1787787362.434845:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:2.0:1787787362.434855:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07190ee850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+28:10304:x1874630678705152:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:2.0:1787787362.435103:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07190ee850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+29:10304:x1874630678705152:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 248us (446us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1787787362.435111:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:1.0:1787787362.534343:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787362.534638:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678705408 00000100:00100000:3.0:1787787362.534647:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678705408 00000100:00100000:3.0:1787787362.534706:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 46 00000100:00100000:3.0:1787787362.534716:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07070903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+29:10314:x1874630678705408:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787787362.534738:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787362.534758:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b142e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c350da expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787362.534874:0:9687:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787787362.534995:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b142e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350da expref: 31 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.535027:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:3.0:1787787362.535030:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787787362.535035:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b142e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350da expref: 31 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.535048:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708770000, rc 0) 00000100:00100000:3.0:1787787362.535106:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07070903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+30:10314:x1874630678705408:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 391us (771us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1787787362.535114:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 46 00000100:00100000:2.0:1787787362.539004:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787362.539159:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678705536 00000100:00100000:0.0:1787787362.539321:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678705536 00000100:00100000:0.0:1787787362.539381:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 47 00000100:00100000:0.0:1787787362.539390:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fefd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+30:10314:x1874630678705536:12345-192.168.206.10@tcp:34:lfs.0 00010000:00010000:0.0:1787787362.539490:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b143c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.539507:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b143c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.539528:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b143c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.539556:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1443 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.539564:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.539572:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.539658:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b144a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.539666:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b144a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.539673:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b144a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787787362.539717:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b144a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.539729:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b143c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.539735:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b143c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.539742:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b143c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.539748:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fd200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787362.539752:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b143c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.539766:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b143c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.539778:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d07078d0f00) 00010000:00010000:0.0:1787787362.539781:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787362.539786:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b143c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.539791:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b143c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.539804:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.539811:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1443 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.539817:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1443 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.539822:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fd400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787362.539825:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1443 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.539830:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1443 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.539836:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d07096a0300) 00010000:00010000:0.0:1787787362.539838:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787362.539841:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1443 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.539857:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1443 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.539873:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b144a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.539879:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b144a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.539885:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b144a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.539890:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fcc00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787362.539893:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b144a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.539899:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b144a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.540029:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07096a0400) 00010000:00010000:0.0:1787787362.540032:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787362.540036:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b144a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.540041:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b144a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787362.540116:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fefd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+30:10314:x1874630678705536:12345-192.168.206.10@tcp:34:lfs.0 Request processed in 725us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787362.540848:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 47 00000100:00100000:0.0:1787787362.544311:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787362.544393:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678705792 00000100:00100000:3.0:1787787362.544402:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678705792 00000100:00100000:3.0:1787787362.544571:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:3.0:1787787362.544581:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073475e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+30:10314:x1874630678705792:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:3.0:1787787362.544819:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073475e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+31:10314:x1874630678705792:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 239us (515us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1787787362.544827:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:2.0:1787787362.583102:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787362.583291:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678706048 00000100:00100000:0.0:1787787362.583300:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678706048 00000100:00100000:0.0:1787787362.583353:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 48 00000100:00100000:0.0:1787787362.583361:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073feff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+31:10317:x1874630678706048:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787787362.583382:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787362.583401:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1451 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c350e1 expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.583511:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1458 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.583533:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1458 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.583543:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1458 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.583556:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b145f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.583562:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b145f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.583567:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b145f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.583673:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1466 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.583680:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1466 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.583701:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1466 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787362.583710:0:9687:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787787362.583816:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1458 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.583824:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1458 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.583830:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1458 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.583835:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fd400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787362.583839:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1458 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.583846:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1458 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.583858:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d07078d0f00) 00010000:00010000:0.0:1787787362.583861:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787362.583865:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1458 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.583871:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1458 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.584398:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b145f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.584407:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b145f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.584422:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b145f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.584426:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fd200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787362.584429:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b145f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.584435:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b145f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.584507:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d07096a0300) 00010000:00010000:0.0:1787787362.584510:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787362.584513:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b145f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.584530:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b145f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.584580:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1451 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350e1 expref: 34 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.584599:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1466 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350e1 expref: 33 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.584606:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07096a0400) 00010000:00010000:0.0:1787787362.584608:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787787362.584611:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d07059fc600, rc 0) 00000100:00100000:0.0:1787787362.584676:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073feff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+33:10317:x1874630678706048:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 1314us (1581us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1787787362.584694:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 48 00000100:00100000:1.0:1787787362.589031:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787362.589878:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678706176 00000100:00100000:3.0:1787787362.589898:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678706176 00000100:00100000:2.0:1787787362.590516:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 49 00000100:00100000:2.0:1787787362.590538:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+33:10317:x1874630678706176:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:2.0:1787787362.590603:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1474 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.590631:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1474 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.590642:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1474 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.590668:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1474 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.590675:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1474 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.590682:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1474 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.590688:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787362.590692:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1474 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.590698:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1474 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.590708:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07096a0400) 00010000:00010000:2.0:1787787362.590711:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787787362.590716:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1474 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.590722:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1474 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787362.590800:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+33:10317:x1874630678706176:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 265us (1782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787362.590815:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 49 00000100:00100000:1.0:1787787362.593932:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787362.594012:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678706432 00000100:00100000:2.0:1787787362.594022:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678706432 00000100:00100000:2.0:1787787362.594082:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:2.0:1787787362.594092:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+33:10317:x1874630678706432:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:2.0:1787787362.594431:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+34:10317:x1874630678706432:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 339us (506us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1787787362.594466:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:1.0:1787787362.867363:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787362.867511:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678706688 00000100:00100000:2.0:1787787362.867531:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678706688 00000100:00100000:2.0:1787787362.867591:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 50 00000100:00100000:2.0:1787787362.867602:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070596cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+34:10348:x1874630678706688:12345-192.168.206.10@tcp:101:cat.0 00010000:00010000:2.0:1787787362.867627:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787362.867647:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b147b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c350e8 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.867904:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b1482 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.867919:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b1482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.867931:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b1482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787362.867941:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787787362.868118:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b147b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350e8 expref: 37 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.868149:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b1482 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350e8 expref: 36 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787362.868157:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07096a0400) 00010000:00010000:2.0:1787787362.868504:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787787362.868508:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd38400, rc 0) 00000100:00100000:2.0:1787787362.868580:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070596cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+36:10348:x1874630678706688:12345-192.168.206.10@tcp:101:cat.0 Request processed in 979us (1225us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1787787362.868588:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 50 00000100:00100000:1.0:1787787362.875569:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787362.875645:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787362.875792:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678706944 00000100:00100000:2.0:1787787362.875800:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678706944 00000100:00100000:2.0:1787787362.875858:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:2.0:1787787362.875867:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070596d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+36:10348:x1874630678706944:12345-192.168.206.10@tcp:35:cat.0 00000100:00100000:2.0:1787787362.876128:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070596d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+37:10348:x1874630678706944:12345-192.168.206.10@tcp:35:cat.0 Request processed in 260us (565us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787787362.876136:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:3.0:1787787362.878661:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678707072 00000100:00100000:3.0:1787787362.878674:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678707072 00000100:00100000:3.0:1787787362.878747:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 3 00000100:00100000:3.0:1787787362.878758:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0708738850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+37:2345:x1874630678707072:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787362.878774:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787362.878798:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b1482 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350e8 expref: 37 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.878836:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07096a0400) 00010000:00010000:3.0:1787787362.878842:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787362.878900:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0708738850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+36:2345:x1874630678707072:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 143us (3253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787362.878908:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 3 00010000:00010000:1.0:1787787362.940863:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787362.977670:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787362.977814:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678707328 00000100:00100000:0.0:1787787362.977824:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678707328 00000100:00100000:0.0:1787787362.977883:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 51 00000100:00100000:0.0:1787787362.977893:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070596c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+36:10354:x1874630678707328:12345-192.168.206.10@tcp:101:dd.0 00010000:00010000:0.0:1787787362.977916:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787362.977920:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787787362.977946:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b13e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350be expref: 36 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.977964:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d07078d0f00) 00010000:00010000:0.0:1787787362.977969:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787787362.977982:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1490 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c350ef expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.978072:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1497 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.978086:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1466 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350e1 expref: 36 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.978095:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1497 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.978126:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1466 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350e1 expref: 36 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787362.978139:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1466 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350e1 expref: 36 pid: 9687 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787362.978178:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073475d680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1874630694465792:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787787362.978273:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073d9bc780 going to sleep for 11 seconds 00000100:00100000:1.0:1787787362.980753:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073475d680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1874630694465792:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787787362.980779:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1497 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787362.983122:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787362.983420:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678707456 00000100:00100000:3.0:1787787362.983428:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678707456 00010000:00010000:3.0:1787787362.983495:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1466 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350e1 expref: 37 pid: 9687 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787362.983542:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 38 00000100:00100000:3.0:1787787362.983553:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070596ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+37:2345:x1874630678707456:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787362.983567:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787362.983574:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1466 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350e1 expref: 37 pid: 9687 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.983587:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1466 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350e1 expref: 37 pid: 9687 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.983610:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1466 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350e1 expref: 37 pid: 9687 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.983631:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07096a0400) 00010000:00010000:3.0:1787787362.983636:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1497 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.983662:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1497 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.983669:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1497 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787362.983818:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787787362.983933:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1497 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787362.983941:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1497 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787362.983959:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787787362.984117:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1490 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350ef expref: 38 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787362.984133:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1497 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350ef expref: 37 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787362.984140:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07096a0400) 00010000:00010000:1.0:1787787362.984142:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787787362.984144:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d07059fd200, rc 0) 00000100:00100000:3.0:1787787362.984200:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070596ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+37:2345:x1874630678707456:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 649us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787362.984208:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 38 00000100:00100000:1.0:1787787362.989400:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070596c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+36:10354:x1874630678707328:12345-192.168.206.10@tcp:101:dd.0 Request processed in 11498us (11728us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1787787362.989414:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 51 00000100:00100000:0.0:1787787363.001352:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787363.002541:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678707712 00000100:00100000:3.0:1787787363.002554:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678707712 00000100:00100000:3.0:1787787363.002662:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 52 00000100:00100000:3.0:1787787363.002674:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073475d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+36:10354:x1874630678707712:12345-192.168.206.10@tcp:36:dd.0 00010000:00010000:3.0:1787787363.003077:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b14a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.003094:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b14a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.003107:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b14a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787787363.003239:0:9687:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1787787363.003267:0:9687:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000086652e37 reply state 0000000087ab4e11 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b14a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787363.003276:0:9687:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787787363.003373:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073475d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+39:10354:x1874630678707712:12345-192.168.206.10@tcp:36:dd.0 Request processed in 701us (2029us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1787787363.003397:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 52 00000020:00080000:3.0:1787787363.003403:0:9687:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1787787363.003471:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787787363.008531:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b14a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787363.008548:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b14a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787363.008556:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b14a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787363.008561:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708770000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787363.008566:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b14a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787363.008573:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b14a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787363.008589:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07096a0400) 00010000:00010000:0.0:1787787363.008592:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787363.008597:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b14a5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787363.008605:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b14a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787363.302185:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787363.302253:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787363.302385:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678707968 00000100:00100000:2.0:1787787363.302395:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678707968 00000100:00100000:2.0:1787787363.302493:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 121 00000100:00100000:2.0:1787787363.302502:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073475ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2344:x1874630678707968:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787787363.302560:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678707840 00000100:00100000:1.0:1787787363.302564:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678707840 00000100:00100000:2.0:1787787363.302586:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073475ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2344:x1874630678707968:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 86us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787363.302593:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 279 00000100:00100000:2.0:1787787363.302594:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 121 00000100:00100000:1.0:1787787363.302606:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2344:x1874630678707840:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787787363.302632:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2344:x1874630678707840:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 28us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787363.302638:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 279 00000100:00080000:0.0:1787787363.303740:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787787363.345081:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787363.347823:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678708096 00000100:00100000:2.0:1787787363.347856:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678708096 00000100:00100000:2.0:1787787363.347928:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 53 00000100:00100000:2.0:1787787363.347938:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070596e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+38:10368:x1874630678708096:12345-192.168.206.10@tcp:101:stat.0 00010000:00010000:2.0:1787787363.347972:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787363.347994:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b14ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c350f6 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.348065:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b14b3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.348080:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b14b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.348092:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b14b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.348106:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b14ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.348112:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b14ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.348119:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b14ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.348213:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b14c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.348224:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1497 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350ef expref: 39 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.348232:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b14c1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.348272:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1497 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350ef expref: 39 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.348287:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1497 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350ef expref: 39 pid: 5820 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787363.348300:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fefc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5819:1874630694465920:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787787363.348407:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073476eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787787363.355039:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787363.355346:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fefc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5819:1874630694465920:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787787363.355372:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b14c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787363.358569:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678708352 00000100:00100000:0.0:1787787363.358585:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678708352 00000100:00100000:0.0:1787787363.358663:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:0.0:1787787363.358674:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fefde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+40:5580:x1874630678708352:12345-192.168.206.10@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787787363.358997:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fefde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+41:5580:x1874630678708352:12345-192.168.206.10@tcp:35:ldlm_bl.0 Request processed in 324us (3965us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1787787363.359005:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:0.0:1787787363.362594:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787363.362678:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678708480 00000100:00100000:3.0:1787787363.362687:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678708480 00010000:00010000:3.0:1787787363.362721:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1497 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350ef expref: 41 pid: 5820 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787363.362811:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 39 00000100:00100000:3.0:1787787363.362821:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073475c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+41:2345:x1874630678708480:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787363.362834:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787363.362841:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1497 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350ef expref: 41 pid: 5820 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.362854:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1497 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350ef expref: 41 pid: 5820 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.362874:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1497 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350ef expref: 41 pid: 5820 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.362889:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07096a0400) 00010000:00010000:3.0:1787787363.362896:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b14c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.362905:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b14c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.362912:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b14c1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.362958:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787787363.363075:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b14c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.363084:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b14c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787363.363128:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787787363.363133:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787787363.363173:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b14c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.363185:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b14c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.363195:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b14b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.363201:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b14b3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787363.363205:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073475c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+40:2345:x1874630678708480:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 208us (442us total) trans 0 rc 0/0 00010000:00010000:2.0:1787787363.363207:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b14b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787363.363214:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 39 00010000:00010000:2.0:1787787363.363220:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd38200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787363.363224:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b14b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.363230:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b14b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.363240:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d07078d0f00) 00010000:00010000:2.0:1787787363.363243:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787363.363247:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b14b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.363253:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b14b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.363264:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b14ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.363270:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b14ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.363275:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b14ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.363280:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd38600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787363.363282:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b14ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.363287:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b14ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.363304:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d07078d0b00) 00010000:00010000:2.0:1787787363.363306:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787363.363308:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b14ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.363314:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b14ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.363545:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b14ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350f6 expref: 40 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.363562:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b14c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350f6 expref: 39 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.363569:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07096a0400) 00010000:00010000:2.0:1787787363.363571:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787787363.363574:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd38000, rc 0) 00000100:00100000:2.0:1787787363.363611:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070596e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+39:10368:x1874630678708096:12345-192.168.206.10@tcp:101:stat.0 Request processed in 15675us (18555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787363.363619:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 53 00000100:00100000:0.0:1787787363.486888:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787363.486983:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678708736 00000100:00100000:2.0:1787787363.486993:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678708736 00000100:00100000:2.0:1787787363.487048:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 54 00000100:00100000:2.0:1787787363.487058:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073475d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+39:10374:x1874630678708736:12345-192.168.206.10@tcp:36:truncate.0 00010000:00010000:2.0:1787787363.487117:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787363.487142:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b14c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350f6 expref: 39 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.487180:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07096a0400) 00010000:00010000:2.0:1787787363.487184:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787787363.487369:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b14c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.487384:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b14c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.487392:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b14c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787787363.487484:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1787787363.487530:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd0faa62 reply state 000000006058f4f2 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b14c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787363.487539:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787787363.487654:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073475d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+41:10374:x1874630678708736:12345-192.168.206.10@tcp:36:truncate.0 Request processed in 597us (775us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1787787363.487663:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 54 00000020:00080000:2.0:1787787363.487667:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787787363.495535:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b14c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.495561:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b14c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.495568:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b14c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.495574:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787363.495590:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b14c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.495598:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b14c8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.495614:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07096a0400) 00010000:00010000:2.0:1787787363.495617:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787363.495621:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b14c8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.495628:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b14c8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787363.700080:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787363.700273:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678708864 00000100:00100000:3.0:1787787363.700282:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678708864 00000100:00100000:3.0:1787787363.700341:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 55 00000100:00100000:3.0:1787787363.700351:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073475fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+40:10388:x1874630678708864:12345-192.168.206.10@tcp:101:stat.0 00010000:00010000:3.0:1787787363.700372:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787363.700393:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b14cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c350fd expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.700487:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b14d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.700501:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b14d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.700523:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b14d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.700537:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b14dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.700545:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b14dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.700551:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b14dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.700660:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b14e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.700669:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b14e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.700676:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b14e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787363.700712:0:9687:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1787787363.700717:0:9687:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787787363.700737:0:9687:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b14e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.700749:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b14e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.700758:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b14d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.700765:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b14d6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.700772:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b14d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.700778:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708770200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787363.700794:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b14d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.700801:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b14d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.700820:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d07078d0f00) 00010000:00010000:3.0:1787787363.700823:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787363.700827:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b14d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.700833:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b14d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.700846:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b14dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.700852:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b14dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.700857:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b14dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.700863:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708771800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787363.700865:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b14dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.700871:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b14dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.700878:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d071b71d600) 00010000:00010000:3.0:1787787363.700881:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787363.700884:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b14dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.700889:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b14dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.702263:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b14cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350fd expref: 42 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.702280:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b14e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350fd expref: 41 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.702287:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07096a0400) 00010000:00010000:3.0:1787787363.702290:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787787363.702293:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708770800, rc 0) 00000100:00100000:3.0:1787787363.702415:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073475fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+41:10388:x1874630678708864:12345-192.168.206.10@tcp:101:stat.0 Request processed in 2063us (2351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787363.702423:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 55 00000100:00100000:0.0:1787787363.797254:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787363.797364:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678709120 00000100:00100000:2.0:1787787363.797375:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678709120 00000100:00100000:2.0:1787787363.797458:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 56 00000100:00100000:2.0:1787787363.797470:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07185a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+41:10398:x1874630678709120:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787787363.797491:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787363.797525:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b14eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35104 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787363.797892:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787787363.798081:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b14eb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35104 expref: 43 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.798096:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:2.0:1787787363.798099:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787787363.798104:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b14eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35104 expref: 43 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.798139:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd39000, rc 0) 00000100:00100000:2.0:1787787363.798206:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07185a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+42:10398:x1874630678709120:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 738us (962us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1787787363.798215:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 56 00000100:00100000:1.0:1787787363.802752:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787363.802845:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678709376 00000100:00100000:0.0:1787787363.802854:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678709376 00000100:00100000:0.0:1787787363.802919:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:0.0:1787787363.802929:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070596d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+42:10398:x1874630678709376:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:0.0:1787787363.803750:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070596d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+43:10398:x1874630678709376:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 819us (1004us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1787787363.803759:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:0.0:1787787363.879572:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787363.880118:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678709632 00000100:00100000:2.0:1787787363.880129:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678709632 00000100:00100000:2.0:1787787363.880303:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 57 00000100:00100000:2.0:1787787363.880314:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07185a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+43:10404:x1874630678709632:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:2.0:1787787363.880336:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787363.880357:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b14f9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3510b expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.880492:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b1500 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.880507:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b14e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350fd expref: 44 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.880526:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b1500 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.880557:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b14e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350fd expref: 44 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.880570:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b14e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350fd expref: 44 pid: 9687 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787363.880602:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fefcf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5819:1874630694466048:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787787363.880745:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073476e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787363.883890:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787363.884090:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fefcf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5819:1874630694466048:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787787363.884116:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b1500 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787363.884293:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678709760 00000100:00100000:0.0:1787787363.884300:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678709760 00010000:00010000:0.0:1787787363.884336:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b14e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350fd expref: 45 pid: 9687 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787363.884375:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 40 00000100:00100000:0.0:1787787363.884397:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070596f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+45:2344:x1874630678709760:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787363.884412:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787363.884420:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b14e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350fd expref: 45 pid: 9687 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787363.884432:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b14e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350fd expref: 45 pid: 9687 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787363.884495:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b14e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350fd expref: 45 pid: 9687 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787363.884521:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07096a0400) 00010000:00010000:0.0:1787787363.884525:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b1500 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787363.884535:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b1500 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787363.884543:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b1500 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787363.884568:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787363.884619:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070596f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+44:2344:x1874630678709760:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 224us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787363.884627:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 40 00010000:00010000:2.0:1787787363.884750:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b1500 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.884758:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b1500 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787363.884776:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1787787363.884938:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b14f9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3510b expref: 45 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.884953:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b1500 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3510b expref: 44 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.884961:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07096a0400) 00010000:00010000:2.0:1787787363.884963:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787787363.884966:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd38000, rc 0) 00000100:00100000:2.0:1787787363.884993:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07185a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+44:10404:x1874630678709632:12345-192.168.206.10@tcp:101:bash.0 Request processed in 4682us (5430us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1787787363.885000:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 57 00000100:00100000:1.0:1787787363.888127:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787363.888242:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678710016 00000100:00100000:3.0:1787787363.888250:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678710016 00000100:00100000:3.0:1787787363.888304:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 58 00000100:00100000:3.0:1787787363.888313:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070596c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+44:10404:x1874630678710016:12345-192.168.206.10@tcp:36:bash.0 00010000:00010000:3.0:1787787363.888704:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b150e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.888720:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b150e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.888731:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b150e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787787363.888780:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1787787363.888806:0:5820:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000913307cd reply state 000000009671d7dc transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b150e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787363.888832:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787787363.888966:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070596c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+47:10404:x1874630678710016:12345-192.168.206.10@tcp:36:bash.0 Request processed in 653us (846us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1787787363.888974:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 58 00000020:00080000:3.0:1787787363.888978:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787787363.897005:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787363.897082:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678710144 00000100:00100000:2.0:1787787363.897101:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678710144 00000100:00100000:2.0:1787787363.897166:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 59 00000100:00100000:2.0:1787787363.897176:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070596de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+47:10404:x1874630678710144:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:2.0:1787787363.897201:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787363.897221:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1515 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35112 expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.897299:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b151c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.897312:0:9687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b1500 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3510b expref: 48 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.897319:0:9687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b150e lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.897326:0:9687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b151c lrc: 5/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.897343:0:9687:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b150e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.897365:0:9687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b1500 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3510b expref: 48 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787363.897377:0:9687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b1500 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3510b expref: 48 pid: 5819 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787363.897390:0:9687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fefcf00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9687:1874630694466176:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787787363.897500:0:9687:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073476ecc0 going to sleep for 11 seconds 00010000:00010000:0.0:1787787363.897863:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b150e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787363.897871:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b150e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787363.897885:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b150e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787363.897890:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708770000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787363.897893:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b150e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787363.897900:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b150e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787363.897914:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07096a0400) 00010000:00010000:0.0:1787787363.897917:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787363.897920:0:3277:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b151c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787363.897929:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b150e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787363.897936:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b150e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787363.900546:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787363.900671:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678710272 00000100:00100000:1.0:1787787363.900679:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678710272 00010000:00010000:1.0:1787787363.900715:0:8496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b1500 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3510b expref: 48 pid: 5819 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787363.900756:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 41 00000100:00100000:1.0:1787787363.900766:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07185a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+48:2345:x1874630678710272:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787787363.900780:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787363.900786:0:8496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b1500 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3510b expref: 48 pid: 5819 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787363.900799:0:8496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b1500 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3510b expref: 48 pid: 5819 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787363.900845:0:8496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07096a0400) 00010000:00010000:1.0:1787787363.900849:0:8496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b151c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787363.900857:0:8496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b151c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787363.900864:0:8496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b151c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787363.900881:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787363.900927:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07185a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+48:2345:x1874630678710272:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 162us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787363.900935:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 41 00010000:00010000:3.0:1787787363.901385:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b1500 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3510b expref: 47 pid: 5819 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787363.901400:0:9687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fefcf00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9687:1874630694466176:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787787363.901417:0:9687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b151c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.901425:0:9687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b151c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.901430:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b151c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787363.901604:0:9687:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787787363.901608:0:9687:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787787363.901627:0:9687:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b151c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.901655:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1515 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35112 expref: 47 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.901668:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b151c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35112 expref: 46 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787363.901692:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07096a0400) 00010000:00010000:3.0:1787787363.901695:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787787363.901698:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd38200, rc 0) 00000100:00100000:3.0:1787787363.901735:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070596de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+46:10404:x1874630678710144:12345-192.168.206.10@tcp:101:bash.0 Request processed in 4561us (4739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787363.901743:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 59 00000100:00100000:0.0:1787787363.906773:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787363.906888:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678710528 00000100:00100000:2.0:1787787363.906898:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678710528 00000100:00100000:2.0:1787787363.906961:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:2.0:1787787363.906971:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07190ee450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+46:10404:x1874630678710528:12345-192.168.206.10@tcp:35:bash.0 00000100:00100000:2.0:1787787363.907180:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07190ee450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+47:10404:x1874630678710528:12345-192.168.206.10@tcp:35:bash.0 Request processed in 210us (414us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1787787363.907188:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 15 00010000:00010000:2.0:1787787363.964899:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787364.020907:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787364.020997:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678710784 00000100:00100000:2.0:1787787364.021007:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678710784 00000100:00100000:2.0:1787787364.021062:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 60 00000100:00100000:2.0:1787787364.021070:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070596cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+47:10414:x1874630678710784:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787787364.021093:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787364.021112:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1523 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35119 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787364.021212:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787787364.021322:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1523 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35119 expref: 49 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.021336:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:2.0:1787787364.021338:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787787364.021343:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1523 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35119 expref: 49 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.021357:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd39000, rc 0) 00000100:00100000:2.0:1787787364.021435:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070596cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+48:10414:x1874630678710784:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 365us (537us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1787787364.021497:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 60 00000100:00100000:1.0:1787787364.023709:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787364.023794:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678710912 00000100:00100000:2.0:1787787364.023813:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678710912 00000100:00100000:2.0:1787787364.023866:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 61 00000100:00100000:2.0:1787787364.023875:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070596f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+48:10414:x1874630678710912:12345-192.168.206.10@tcp:34:lfs.0 00010000:00010000:2.0:1787787364.023957:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1531 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.023974:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1531 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.023986:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1531 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.024002:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b1538 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.024008:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b1538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.024014:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b1538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.024116:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b153f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.024125:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b153f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.024132:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b153f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787787364.024195:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b153f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.024209:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1531 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.024215:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1531 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.024223:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1531 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.024229:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787364.024234:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1531 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.024241:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1531 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.024252:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d07078d0f00) 00010000:00010000:2.0:1787787364.024255:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787364.024260:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1531 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.024266:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1531 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.024279:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b1538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.024286:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b1538 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.024298:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b1538 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.024304:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd38400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787364.024307:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b1538 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.024313:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b1538 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.024321:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d07078d0b00) 00010000:00010000:2.0:1787787364.024324:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787364.024326:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b1538 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.024332:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b1538 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.024346:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b153f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.024352:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b153f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.024358:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b153f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.024362:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787364.024371:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b153f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.024388:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b153f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.024396:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07096a0400) 00010000:00010000:2.0:1787787364.024398:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787364.024401:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b153f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.024407:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b153f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787364.024500:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070596f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+48:10414:x1874630678710912:12345-192.168.206.10@tcp:34:lfs.0 Request processed in 626us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787364.024520:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 61 00000100:00100000:0.0:1787787364.028840:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787364.029036:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678711168 00000100:00100000:2.0:1787787364.029046:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678711168 00000100:00100000:2.0:1787787364.029109:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:2.0:1787787364.029118:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07185a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+48:10414:x1874630678711168:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:2.0:1787787364.029365:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07185a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+49:10414:x1874630678711168:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 246us (534us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1787787364.029373:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:1.0:1787787364.072711:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787364.072784:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678711424 00000100:00100000:3.0:1787787364.072794:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678711424 00000100:00100000:3.0:1787787364.072856:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 62 00000100:00100000:3.0:1787787364.072866:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070596da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+49:10417:x1874630678711424:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787787364.072898:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787364.072927:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1546 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35120 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787364.073000:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b154d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787364.073013:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b154d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787364.073023:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b154d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787364.073051:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b1554 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787364.073058:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b1554 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787364.073083:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b1554 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787364.073196:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b155b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787364.073206:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b155b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787364.073213:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b155b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787364.073221:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787787364.073302:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b154d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787364.073309:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b154d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787364.073315:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b154d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787364.073321:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708770200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787364.073324:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b154d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787364.073330:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b154d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787364.073340:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d07078d0f00) 00010000:00010000:3.0:1787787364.073343:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787364.073352:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b154d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787364.073358:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b154d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787364.073370:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b1554 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787364.073375:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b1554 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787364.073380:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b1554 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787364.073385:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708771e00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787364.073387:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b1554 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787364.073392:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b1554 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787364.073397:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d071b71d600) 00010000:00010000:3.0:1787787364.073399:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787364.073401:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b1554 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787364.073406:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b1554 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787364.073480:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1546 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35120 expref: 52 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787364.073503:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b155b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35120 expref: 51 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787364.073519:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07096a0400) 00010000:00010000:3.0:1787787364.073521:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787787364.073524:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708770000, rc 0) 00000100:00100000:3.0:1787787364.073731:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070596da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+51:10417:x1874630678711424:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 866us (1026us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1787787364.073739:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 62 00000100:00100000:1.0:1787787364.078147:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787364.078282:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787364.078313:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678711552 00000100:00100000:0.0:1787787364.078322:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678711552 00000100:00100000:2.0:1787787364.078368:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678711680 00000100:00100000:2.0:1787787364.078373:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678711680 00000100:00100000:0.0:1787787364.078382:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:0.0:1787787364.078390:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070596fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+52:2344:x1874630678711552:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787364.078405:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787787364.078460:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 63 00010000:00010000:0.0:1787787364.078460:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b155b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35120 expref: 52 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787364.078468:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070596f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+52:10417:x1874630678711680:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:0.0:1787787364.078477:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07096a0400) 00010000:00010000:0.0:1787787364.078481:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787787364.078527:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1569 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787364.078545:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070596fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+51:2344:x1874630678711552:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 156us (407us total) trans 0 rc 0/0 00010000:00010000:2.0:1787787364.078552:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787364.078552:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 4 00010000:00010000:2.0:1787787364.078561:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.078587:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.078593:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1569 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.078599:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1569 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.078604:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787364.078608:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1569 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.078614:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1569 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.078622:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07096a0400) 00010000:00010000:2.0:1787787364.078625:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787787364.078629:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1569 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.078635:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1569 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787364.078674:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070596f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+50:10417:x1874630678711680:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 207us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787364.078687:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 63 00000100:00100000:3.0:1787787364.080733:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787364.080822:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678711936 00000100:00100000:2.0:1787787364.080830:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678711936 00000100:00100000:3.0:1787787364.081071:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 17 00000100:00100000:3.0:1787787364.081082:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+50:10417:x1874630678711936:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:3.0:1787787364.081376:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+51:10417:x1874630678711936:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 295us (649us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1787787364.081384:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 17 00000100:00100000:0.0:1787787364.304567:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787364.304658:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678712192 00000100:00100000:3.0:1787787364.304668:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678712192 00000100:00100000:3.0:1787787364.304725:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 64 00000100:00100000:3.0:1787787364.304735:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+51:10435:x1874630678712192:12345-192.168.206.10@tcp:101:cat.0 00010000:00010000:3.0:1787787364.304758:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787364.304778:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1570 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35127 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787364.304883:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b1577 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787364.304910:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b1577 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787364.304921:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b1577 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787364.304933:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787787364.305064:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1570 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35127 expref: 54 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787364.305083:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b1577 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35127 expref: 53 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787364.305091:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07096a0400) 00010000:00010000:3.0:1787787364.305094:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787787364.305098:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708771e00, rc 0) 00000100:00100000:3.0:1787787364.305649:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+53:10435:x1874630678712192:12345-192.168.206.10@tcp:101:cat.0 Request processed in 913us (1089us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1787787364.305657:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 64 00000100:00100000:0.0:1787787364.348413:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787364.348680:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678712320 00000100:00100000:1.0:1787787364.348689:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678712320 00000100:00100000:1.0:1787787364.348745:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 65 00000100:00100000:1.0:1787787364.348755:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+53:10436:x1874630678712320:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787787364.348777:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787364.348969:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b1585 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3512e expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.349031:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b158c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.349223:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b158c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.349236:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b158c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787364.349296:0:9687:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1787787364.349299:0:9687:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787787364.349318:0:9687:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b158c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.349343:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b1585 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3512e expref: 55 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.349361:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b158c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3512e expref: 54 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.349369:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d07078d0f00) 00010000:00010000:1.0:1787787364.349372:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787787364.349375:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d072212ba00, rc 0) 00000100:00100000:1.0:1787787364.349526:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+54:10436:x1874630678712320:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 772us (1121us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787364.349534:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 65 00000100:00100000:1.0:1787787364.364339:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787364.367072:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678712704 00000100:00100000:2.0:1787787364.367085:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678712704 00000100:00100000:2.0:1787787364.367164:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 18 00000100:00100000:2.0:1787787364.367174:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070596e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+54:10436:x1874630678712704:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:2.0:1787787364.367536:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070596e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+55:10436:x1874630678712704:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 361us (3205us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1787787364.367555:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 18 00000100:00100000:0.0:1787787364.370691:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787364.370810:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678712832 00000100:00100000:1.0:1787787364.370819:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678712832 00000100:00100000:1.0:1787787364.371044:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:1.0:1787787364.371056:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+55:10436:x1874630678712832:12345-192.168.206.10@tcp:103:lfs.0 00010000:00010000:1.0:1787787364.371090:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787787364.371124:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b151c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35112 expref: 55 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.371149:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b1577 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35127 expref: 54 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.371172:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd800/0xdeb1953cba4b1427 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c350d3 expref: 53 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.371184:0:8496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07096a0400) 00010000:00010000:1.0:1787787364.371194:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787364.371256:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+52:10436:x1874630678712832:12345-192.168.206.10@tcp:103:lfs.0 Request processed in 203us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787364.371263:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:0.0:1787787364.373868:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787364.374049:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678712960 00000100:00100000:1.0:1787787364.374059:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678712960 00000100:00100000:1.0:1787787364.374113:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 66 00000100:00100000:1.0:1787787364.374123:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+52:10436:x1874630678712960:12345-192.168.206.10@tcp:58:lfs.0 00010000:00010000:1.0:1787787364.374255:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b1593 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.374272:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b1593 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.374283:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b1593 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787787364.374610:0:5821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787787364.374815:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1787787364.374880:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1787787364.375291:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+52:10436:x1874630678712960:12345-192.168.206.10@tcp:58:lfs.0 Request processed in 1166us (1431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787364.375300:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 66 00000100:00100000:3.0:1787787364.405895:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787364.406081:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678713088 00000100:00100000:2.0:1787787364.406090:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678713088 00000100:00100000:2.0:1787787364.406196:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 67 00000100:00100000:2.0:1787787364.406208:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+52:10438:x1874630678713088:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787787364.406227:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787364.406247:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b159a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35135 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.406333:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b15a1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.406346:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b15a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.406358:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b15a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.406371:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b15a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.406385:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b15a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.406392:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b15a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.406529:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b15af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.406537:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b15af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.406544:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b15af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787364.406575:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787787364.406578:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787787364.406593:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b15af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.406604:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b15af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.406612:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b15a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.406618:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b15a1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.406624:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b15a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.406639:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd38400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787364.406643:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b15a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.406650:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b15a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.406661:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d07078d0f00) 00010000:00010000:2.0:1787787364.406664:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787364.406668:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b15a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.406673:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b15a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.406685:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b15a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.406690:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b15a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.406695:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b15a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.406699:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787364.406702:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b15a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.406706:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b15a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.406720:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d07078d0b00) 00010000:00010000:2.0:1787787364.406723:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787364.406725:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b15a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.406731:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b15a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.406760:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b159a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35135 expref: 54 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.406773:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b15af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35135 expref: 53 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.406779:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07114ac400) 00010000:00010000:2.0:1787787364.406780:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787787364.406783:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd39000, rc 0) 00000100:00100000:2.0:1787787364.406842:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+53:10438:x1874630678713088:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 636us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787364.406849:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 67 00000100:00100000:2.0:1787787364.734879:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fefcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1874630694466560:0@lo:400:kworker.0 00000100:00100000:2.0:1787787364.734958:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787364.735017:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787787364.735024:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fefc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694466688:0@lo:400:kworker.0 00000100:00100000:2.0:1787787364.735050:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787364.735346:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fefde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694466304:0@lo:400:kworker.0 00000100:00100000:1.0:1787787364.735380:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787364.735414:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fefc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1874630694466816:0@lo:400:kworker.0 00000100:00100000:1.0:1787787364.735458:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787364.735479:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787787364.735486:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073feff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1874630694466432:0@lo:400:kworker.0 00000100:00100000:1.0:1787787364.735521:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787364.735539:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073475e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694466944:0@lo:400:kworker.0 00000100:00100000:1.0:1787787364.735561:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787364.735591:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694466688 00000100:00100000:1.0:1787787364.735597:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694466688 00000100:00100000:1.0:1787787364.735659:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694466944 00000100:00100000:1.0:1787787364.735663:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694466944 00000100:00100000:1.0:1787787364.735688:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787787364.735697:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0708b58b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694466688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787364.735747:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0708b58b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694466688:12345-0@lo:400:kworker.0 Request processed in 52us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787364.735755:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787787364.735771:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787787364.735777:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070596d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3291:x1874630694466944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787364.735824:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070596d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3291:x1874630694466944:12345-0@lo:400:kworker.0 Request processed in 48us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787364.735831:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787787364.735849:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694466560 00000100:00100000:1.0:1787787364.735853:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694466560 00000100:00100000:1.0:1787787364.735879:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694466816 00000100:00100000:1.0:1787787364.735882:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694466816 00000100:00100000:1.0:1787787364.735911:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694466432 00000100:00100000:1.0:1787787364.735915:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694466432 00000100:00100000:1.0:1787787364.735929:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787787364.735936:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874630694466560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787364.735967:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874630694466560:12345-0@lo:400:kworker.0 Request processed in 31us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787364.735973:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787787364.735985:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787787364.735991:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070596e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1874630694466816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787364.736017:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070596e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1874630694466816:12345-0@lo:400:kworker.0 Request processed in 27us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787364.736023:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787787364.736034:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787787364.736040:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070596c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1874630694466432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787364.736067:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070596c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1874630694466432:12345-0@lo:400:kworker.0 Request processed in 27us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787364.736073:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:1.0:1787787364.736096:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787787364.736995:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787787364.737001:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787364.737055:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fefc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694466688:0@lo:400:kworker.0 00000100:00100000:1.0:1787787364.737068:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fefcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1874630694466560:0@lo:400:kworker.0 00000100:00100000:1.0:1787787364.738381:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073feff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1874630694466432:0@lo:400:kworker.0 00000100:00100000:1.0:1787787364.738402:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073475e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694466944:0@lo:400:kworker.0 00000100:00100000:1.0:1787787364.738413:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fefc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1874630694466816:0@lo:400:kworker.0 00000100:00100000:2.0:1787787364.738625:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694466304 00000100:00100000:2.0:1787787364.738631:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694466304 00000100:00100000:2.0:1787787364.738705:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787787364.738714:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3291:x1874630694466304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787364.738783:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3291:x1874630694466304:12345-0@lo:400:kworker.0 Request processed in 71us (3402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787364.738790:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787787364.739797:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fefde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694466304:0@lo:400:kworker.0 00000001:00080000:2.0:1787787364.800466:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967340 is committed 00000001:00080000:2.0:1787787364.800499:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000004:00080000:2.0:1787787364.800759:0:5842:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1787787364.800783:0:5842:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d0706224540 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1787787364.800788:0:5842:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d0704cb6000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d07062243c0 00000020:00080000:2.0:1787787364.800792:0:5842:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d0704cb6400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d073fef8000 00000020:00080000:2.0:1787787364.800822:0:5853:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1787787364.800942:0:5853:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1787787364.801264:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787787364.801283:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694467072:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787787364.801347:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787364.801410:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694467072 00000100:00100000:0.0:1787787364.801417:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694467072 00000100:00100000:0.0:1787787364.801864:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787787364.801879:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3294:x1874630694467072:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787787364.801904:0:6675:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1787787364.801935:0:6675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a8f7861, atime: 0x6a8f7862, ctime: 0x6a8f7861, blocks: 0x1 00010000:00010000:0.0:1787787364.801944:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cd3d8f0/0xdeb1953cba4b15b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787364.801960:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=277s v=(0 0) 00010000:00010000:0.0:1787787364.801965:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787364.801972:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cd3d8f0/0xdeb1953cba4b15b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787364.801995:0:6675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cd3d8f0/0xdeb1953cba4b15b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787364.802005:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cd3d8f0/0xdeb1953cba4b15b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787364.802026:0:6675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cd3d8f0/0xdeb1953cba4b15b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787364.802044:0:6675:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787787364.802663:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3294:x1874630694467072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 786us (1312us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787787364.802673:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1787787364.802711:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787364.802717:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cd3d8f0/0xdeb1953cba4b15b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787364.802725:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fda00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:0.0:1787787364.802729:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cd3d8f0/0xdeb1953cba4b15b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787364.802738:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cd3d8f0/0xdeb1953cba4b15b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787364.802752:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cd3d8f0/0xdeb1953cba4b15b6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787364.802764:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cd3d8f0/0xdeb1953cba4b15b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787364.802779:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787364.802781:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787364.802782:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787787364.802809:0:3294:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d0707a08b40/2, rc 0, transno 4294967301 00000100:00100000:0.0:1787787364.802815:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694467072:0@lo:6:osp-syn-1-0.0 00000040:00080000:3.0:1787787364.925235:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787787364.925244:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787787364.925306:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787787364.925312:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787787364.925470:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0702fd7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874630694467200:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787787364.925577:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071858d240 going to sleep for 11 seconds 00000100:00100000:2.0:1787787364.927702:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0702fd7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874630694467200:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787787364.929372:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787364.929473:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678713216 00000100:00100000:1.0:1787787364.929482:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678713216 00000100:00100000:1.0:1787787364.929554:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00100000:1.0:1787787364.929565:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06020e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c5599457-aa74-4a71-951f-faabe33e6ec7+11:10449:x1874630678713216:12345-192.168.206.10@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787787364.929659:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06020e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c5599457-aa74-4a71-951f-faabe33e6ec7+11:10449:x1874630678713216:12345-192.168.206.10@tcp:900:lhsmtool_posix.0 Request processed in 97us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787364.929667:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00100000:3.0:1787787364.937043:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787364.937161:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678713344 00000100:00100000:1.0:1787787364.937169:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678713344 00000100:00100000:1.0:1787787364.937278:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 68 00000100:00100000:1.0:1787787364.937288:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+11:10449:x1874630678713344:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787787364.937316:0:5821:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787787364.937411:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+11:10449:x1874630678713344:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 124us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787364.937418:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 68 00000100:00100000:2.0:1787787364.944300:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787364.945813:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678713472 00000100:00100000:1.0:1787787364.945825:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678713472 00000100:00100000:1.0:1787787364.945912:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 69 00000100:00100000:1.0:1787787364.945923:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0708b583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+11:10449:x1874630678713472:12345-192.168.206.10@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787787364.945991:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b800/0xdeb1953cba4b15bd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.946007:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b800/0xdeb1953cba4b15bd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.946034:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b800/0xdeb1953cba4b15bd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.946051:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b15c4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.946059:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b15c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.946066:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b15c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.946090:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b15cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.946098:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b15cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.946106:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b15cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787364.946141:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787787364.946145:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787787364.946159:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b15cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.946176:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b800/0xdeb1953cba4b15bd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.946183:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b800/0xdeb1953cba4b15bd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.946190:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b800/0xdeb1953cba4b15bd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.946196:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212b800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787364.946200:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b800/0xdeb1953cba4b15bd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.946207:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b800/0xdeb1953cba4b15bd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.946219:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d071b71da00) 00010000:00010000:1.0:1787787364.946222:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787364.946226:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b800/0xdeb1953cba4b15bd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.946233:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b800/0xdeb1953cba4b15bd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.946245:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b15c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.946251:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b15c4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.946256:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b15c4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.946268:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212b000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787364.946271:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b15c4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.946277:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b15c4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.946285:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9d07114ac700) 00010000:00010000:1.0:1787787364.946287:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787364.946290:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b15c4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.946296:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b15c4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.946310:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b15cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.946316:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b15cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.946322:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b15cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.946328:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212aa00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787364.946331:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b15cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.946336:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b15cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.946354:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07114ac400) 00010000:00010000:1.0:1787787364.946356:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787364.946358:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b15cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.946364:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b15cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787364.946487:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0708b583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+11:10449:x1874630678713472:12345-192.168.206.10@tcp:34:lhsmtool_posix.0 Request processed in 516us (2144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787364.946496:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 69 00000100:00100000:0.0:1787787364.953215:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787364.953310:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678713728 00000100:00100000:2.0:1787787364.953320:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678713728 00000100:00100000:1.0:1787787364.953430:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 70 00000100:00100000:1.0:1787787364.953461:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06020e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+11:10449:x1874630678713728:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787787364.953481:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787364.953501:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b15d2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3513c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.954381:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b15d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.954397:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b15d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.954407:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b15d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787364.954418:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787787364.955292:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b15d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.955602:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b15d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.955610:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b15d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.955617:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212b000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787364.955621:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b15d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.955628:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b15d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.955858:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07114ac400) 00010000:00010000:1.0:1787787364.955862:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787787364.955867:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b15d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.955873:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b15d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.955921:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b15d2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3513c expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.955931:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d071b71da00) 00010000:00010000:1.0:1787787364.955933:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787787364.955937:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b15d2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3513c expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.955945:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d072212aa00, rc 0) 00000100:00100000:1.0:1787787364.956160:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06020e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+12:10449:x1874630678713728:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 2719us (2951us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1787787364.956173:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 70 00000100:00100000:3.0:1787787364.968781:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787364.970170:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678713856 00000100:00100000:2.0:1787787364.970182:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678713856 00000100:00100000:2.0:1787787364.970243:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 71 00000100:00100000:2.0:1787787364.970373:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+12:10449:x1874630678713856:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787787364.970406:0:5819:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787787364.970534:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+12:10449:x1874630678713856:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 164us (1761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787364.970542:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 71 00000100:00100000:2.0:1787787364.983547:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787364.983978:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678714112 00000100:00100000:1.0:1787787364.983988:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678714112 00000100:00100000:1.0:1787787364.984390:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 72 00000100:00100000:1.0:1787787364.984401:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+12:10449:x1874630678714112:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787787364.984420:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787364.984423:0:9687:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787787364.984484:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b158c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3512e expref: 12 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.984500:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d07078d0f00) 00010000:00010000:1.0:1787787364.984515:0:9687:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787787364.984528:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b800/0xdeb1953cba4b15e7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35143 expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787787364.985348:0:9687:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1787787364.987125:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b15ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.987144:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b15ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.987154:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b15ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.987217:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b800/0xdeb1953cba4b15e7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35143 expref: 14 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.987248:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b15ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35143 expref: 13 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787364.987256:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d07114ac700) 00010000:00010000:1.0:1787787364.987259:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787787364.987262:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d072212aa00, rc 0) 00000100:00100000:1.0:1787787364.987329:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+13:10449:x1874630678714112:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 2929us (3790us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1787787364.987338:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 72 00010000:00010000:2.0:1787787364.992232:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787364.992327:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787364.993138:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678714368 00000100:00100000:2.0:1787787364.993149:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678714368 00000100:00100000:2.0:1787787364.993245:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 73 00000100:00100000:2.0:1787787364.993256:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06020e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+13:10449:x1874630678714368:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787787364.993313:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787364.993340:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b15ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35143 expref: 13 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.993356:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d07114ac700) 00010000:00010000:2.0:1787787364.993364:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787787364.993384:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b15fc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.993397:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b15fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.993407:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b15fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.993535:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1603 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xca9ed228 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.993543:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1603 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xca9ed228 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.993550:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1603 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xca9ed228 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.993785:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b15fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.993802:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b15fc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.993809:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b15fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.993815:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd38a00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787364.993819:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b15fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.993826:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b15fc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.993836:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d07078d0f00) 00010000:00010000:2.0:1787787364.993838:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787364.993842:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b15fc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.993848:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b15fc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.993858:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1603 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xca9ed228 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.993863:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1603 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xca9ed228 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.993869:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1603 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xca9ed228 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.993873:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787364.993881:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1603 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xca9ed228 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.993888:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1603 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xca9ed228 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.993897:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xca9ed228 (ffff9d07078d0600) 00010000:00010000:2.0:1787787364.993899:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787364.993902:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1603 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xca9ed228 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787364.993907:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1603 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xca9ed228 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787364.994133:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06020e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+12:10449:x1874630678714368:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 877us (1808us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787787364.994142:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 73 00000100:00100000:1.0:1787787365.004533:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787365.007408:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678714496 00000100:00100000:2.0:1787787365.007420:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678714496 00000100:00100000:2.0:1787787365.007531:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 74 00000100:00100000:2.0:1787787365.007542:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070596d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+12:10449:x1874630678714496:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787787365.007561:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787365.007582:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b160a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3514a expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787365.007620:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1611 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787365.007632:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787365.007656:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787787365.007866:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787787365.007970:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b160a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3514a expref: 14 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787365.007987:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1611 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3514a expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787365.007995:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d07078d0600) 00010000:00010000:2.0:1787787365.007998:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787787365.008001:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd38a00, rc 0) 00000100:00100000:2.0:1787787365.008069:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070596d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+13:10449:x1874630678714496:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 529us (3546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787365.008077:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 74 00000100:00100000:0.0:1787787365.014381:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787365.014746:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678714752 00000100:00100000:3.0:1787787365.014755:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678714752 00000100:00100000:3.0:1787787365.014811:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 75 00000100:00100000:3.0:1787787365.014936:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06020e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+13:10449:x1874630678714752:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787787365.015079:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1618 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787365.015095:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1618 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787365.015107:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1618 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787787365.015369:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1787787365.015379:0:5819:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 277241940196ns, next at 278241937899ns, rc = 0 00000004:00010000:3.0:1787787365.016150:0:5819:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000faa4c91 reply state 00000000822bab0b transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1618 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787365.016163:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787787365.016315:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06020e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+15:10449:x1874630678714752:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 1493us (1939us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1787787365.016324:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 75 00010000:00010000:2.0:1787787365.022737:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1618 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787365.022755:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00010000:00010000:2.0:1787787365.022759:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1618 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787365.022769:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1618 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787365.022775:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708771800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787365.022780:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1618 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787365.022788:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1618 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787365.022813:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d07078d0600) 00010000:00010000:2.0:1787787365.022816:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787787365.022821:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1618 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787365.022827:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1618 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787365.022950:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678714880 00000100:00100000:0.0:1787787365.022959:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678714880 00000100:00100000:0.0:1787787365.023022:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 76 00000100:00100000:0.0:1787787365.023032:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073475e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+14:10449:x1874630678714880:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787787365.023054:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787365.023071:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b161f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35151 expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.023130:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b161f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35151 expref: 15 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.023144:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b161f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35151 expref: 15 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.023177:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d07078d0600) 00010000:00010000:0.0:1787787365.023180:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787787365.023182:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d07059fdc00, rc 0) 00000100:00100000:0.0:1787787365.023241:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073475e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+15:10449:x1874630678714880:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 210us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787365.023248:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 76 00000100:00100000:0.0:1787787365.032472:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787365.034633:0:10776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678715008 00000100:00100000:1.0:1787787365.034646:0:10776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678715008 00000100:00100000:1.0:1787787365.034712:0:10776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 25 00000100:00100000:1.0:1787787365.034721:0:10776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06020ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2341:x1874630678715008:12345-192.168.206.10@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1787787365.034808:0:10776:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c5599457-aa74-4a71-951f-faabe33e6ec7@192.168.206.10@tcp t0 exp 0000000000000000 cur 277 last 0 00000020:00000080:0.0:1787787365.034956:0:10776:0:(genops.c:1385:class_connect()) connect: client c5599457-aa74-4a71-951f-faabe33e6ec7, cookie 0xdeb1953cba4b1626 00002000:00100000:0.0:1787787365.034967:0:10776:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c5599457-aa74-4a71-951f-faabe33e6ec7/ffff9d07055ec800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113934 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787787365.035049:0:10776:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787787365.035249:0:10776:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787787365.035282:0:10776:0:(import.c:65:import_set_state_nolock()) ffff9d07055e9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787787365.035353:0:10776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06020ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2341:x1874630678715008:12345-192.168.206.10@tcp:8:lhsmtool_posix.0 Request processed in 632us (2887us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787365.035362:0:10776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 25 00000100:00100000:2.0:1787787365.041717:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787365.041776:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678715136 00000100:00100000:1.0:1787787365.041785:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678715136 00000100:00080000:2.0:1787787365.041914:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787365.041920:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 26 00000100:00100000:1.0:1787787365.041933:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+6:0:x1874630678715136:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787787365.113179:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+7:0:x1874630678715136:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 Request processed in 71239us (71460us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787787365.113192:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 26 00000001:00100000:3.0:1787787365.113225:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c5599457-aa74-4a71-951f-faabe33e6ec7 00000001:00080000:3.0:1787787365.113236:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:1.0:1787787365.123104:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787365.127744:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678715392 00000100:00100000:0.0:1787787365.127759:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678715392 00000100:00100000:1.0:1787787365.136594:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 19 00000100:00100000:1.0:1787787365.136612:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fefde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+15:10449:x1874630678715392:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787787365.136838:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fefde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+16:10449:x1874630678715392:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 230us (14400us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1787787365.136852:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 19 00000040:00080000:2.0:1787787365.139953:0:11988:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787787365.139962:0:11988:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787787365.140727:0:11988:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787787365.140734:0:11988:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787787365.146559:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787365.147253:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678715648 00000100:00100000:3.0:1787787365.147271:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678715648 00000100:00100000:3.0:1787787365.147331:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 77 00000100:00100000:3.0:1787787365.147341:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0711577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+16:10449:x1874630678715648:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787787365.147468:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0711577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+16:10449:x1874630678715648:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 129us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787365.147476:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 77 00000100:00100000:1.0:1787787365.152952:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787365.153077:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678715776 00000100:00100000:2.0:1787787365.153086:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678715776 00000100:00100000:2.0:1787787365.153155:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 78 00000100:00100000:2.0:1787787365.153167:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fefc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+16:10449:x1874630678715776:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787787365.153187:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787365.153209:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b162d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35158 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787365.153273:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1634 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787365.153287:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1634 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787365.153310:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1634 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787365.153344:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787787365.153361:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1634 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787365.153385:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b162d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35158 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787365.153401:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1634 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35158 expref: 17 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787365.153409:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d07078d0600) 00010000:00010000:2.0:1787787365.153413:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787787365.153416:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd39e00, rc 0) 00000100:00100000:2.0:1787787365.153513:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fefc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+17:10449:x1874630678715776:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 339us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787365.153521:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 78 00000100:00100000:3.0:1787787365.159736:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787365.159800:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678715904 00000100:00100000:0.0:1787787365.159819:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678715904 00000100:00100000:0.0:1787787365.159869:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 27 00000100:00100000:0.0:1787787365.159878:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe00780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2344:x1874630678715904:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787787365.159904:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787365.159926:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7fb81dd/0xdeb1953cba4b163b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3515f expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787787365.159962:0:6674:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f7864, blocks: 0x1 00010000:00010000:0.0:1787787365.160299:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=277s v=(0 0) 00010000:00010000:0.0:1787787365.160305:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787365.160315:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7fb81dd/0xdeb1953cba4b163b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3515f expref: 6 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.160336:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e7fb81dd/0xdeb1953cba4b163b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3515f expref: 6 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.160350:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d07059fc400, rc 0) 00000100:00100000:0.0:1787787365.160412:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe00780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2344:x1874630678715904:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 535us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787365.160421:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 27 00000100:00100000:2.0:1787787365.173358:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787365.173429:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678716160 00000100:00100000:3.0:1787787365.173460:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678716160 00000100:00100000:3.0:1787787365.173519:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 79 00000100:00100000:3.0:1787787365.173529:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+17:10449:x1874630678716160:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787787365.173623:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+17:10449:x1874630678716160:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 95us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787365.173631:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 79 00000100:00100000:3.0:1787787365.181427:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787365.181536:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678716288 00000100:00100000:2.0:1787787365.181545:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678716288 00000100:00100000:2.0:1787787365.181599:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 28 00000100:00100000:2.0:1787787365.181609:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707092d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:10449:x1874630678716288:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787787365.181626:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787365.181643:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030798ded/0xdeb1953cba4b1642 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35166 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787365.181686:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e7fb81dd/0xdeb1953cba4b163b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3515f expref: 7 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787365.181695:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787365.181698:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787365.181703:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030798ded/0xdeb1953cba4b1642 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35166 expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787365.181733:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e7fb81dd/0xdeb1953cba4b163b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3515f expref: 7 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787365.181747:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e7fb81dd/0xdeb1953cba4b163b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3515f expref: 7 pid: 6674 timeout: 377 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787365.181761:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06010b7840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6673:1874630694467328:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787787365.181842:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0702fd1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787365.193219:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787365.193252:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678716416 00000100:00100000:0.0:1787787365.193259:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678716416 00010000:00010000:0.0:1787787365.193296:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e7fb81dd/0xdeb1953cba4b163b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3515f expref: 8 pid: 6674 timeout: 377 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787365.193333:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 42 00000100:00100000:0.0:1787787365.193343:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070873bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+8:2344:x1874630678716416:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787365.193357:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787365.193378:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e7fb81dd/0xdeb1953cba4b163b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3515f expref: 8 pid: 6674 timeout: 377 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.193406:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e7fb81dd/0xdeb1953cba4b163b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3515f expref: 8 pid: 6674 timeout: 377 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.193432:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787365.193456:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787365.193466:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000030798ded/0xdeb1953cba4b1642 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35166 expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.193478:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030798ded/0xdeb1953cba4b1642 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35166 expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.193524:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000030798ded/0xdeb1953cba4b1642 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35166 expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787365.193538:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06020ea1c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5807:1874630694467456:192.168.206.10@tcp:105: 00000100:00100000:0.0:1787787365.193608:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073d9bccc0 going to sleep for 11 seconds 00010000:00010000:2.0:1787787365.195104:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7fb81dd/0xdeb1953cba4b163b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3515f expref: 8 pid: 6674 timeout: 377 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787365.195132:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06010b7840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6673:1874630694467328:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787787365.195157:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000030798ded/0xdeb1953cba4b1642 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35166 expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787365.195170:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd39800, rc 0) 00000100:00100000:2.0:1787787365.195240:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707092d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+7:10449:x1874630678716288:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 13631us (13821us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787365.195248:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 28 00000100:00100000:3.0:1787787365.202220:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06020ea1c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5807:1874630694467456:192.168.206.10@tcp:105: 00010000:00010000:3.0:1787787365.202252:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787365.202325:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070873bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2344:x1874630678716416:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 8983us (9115us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787365.202336:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 42 00000100:00100000:0.0:1787787365.207421:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787365.207618:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678716544 00000100:00100000:2.0:1787787365.207627:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678716544 00002000:00100000:2.0:1787787365.207671:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9d06020e92c0 x1874630678716544/t0(0) o4->c5599457-aa74-4a71-951f-faabe33e6ec7@192.168.206.10@tcp:226/0 lens 504/0 e 0 to 0 dl 1787787376 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787787365.207683:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d06020e92c0 with x1874630678716544 ext(0->8) 00002000:00010000:2.0:1787787365.207689:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d06020e92c0 00000100:00100000:2.0:1787787365.207746:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:2.0:1787787365.207755:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06020e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2344:x1874630678716544:12345-192.168.206.10@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787787365.208632:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06020e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+8:2344:x1874630678716544:12345-192.168.206.10@tcp:4:lhsmtool_posix.0 Request processed in 874us (1216us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787787365.208642:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 0 00002000:00100000:2.0:1787787365.208650:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9d06020e92c0 x1874630678716544/t4294967302(0) o4->c5599457-aa74-4a71-951f-faabe33e6ec7@192.168.206.10@tcp:226/0 lens 504/448 e 0 to 0 dl 1787787376 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787787365.208659:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d06020e92c0 with x1874630678716544 ext(0->8) 00002000:00010000:2.0:1787787365.208663:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d06020e92c0 00000100:00100000:3.0:1787787365.220059:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787365.222276:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678716672 00000100:00100000:2.0:1787787365.222290:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678716672 00000100:00100000:2.0:1787787365.222472:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 80 00000100:00100000:2.0:1787787365.222482:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707091a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+17:10449:x1874630678716672:12345-192.168.206.10@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787787365.249490:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073feff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694467584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787787365.249572:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787365.252122:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694467584 00000100:00100000:1.0:1787787365.252136:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694467584 00000100:00100000:1.0:1787787365.252198:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787787365.252208:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073475c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1874630694467584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787787365.252244:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787787365.252321:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073475c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1874630694467584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (2748us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787365.252328:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787787365.253108:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073feff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694467584:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1787787365.273881:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:2.0:1787787365.273918:0:5842:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:2.0:1787787365.273929:0:5842:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1787787365.273959:0:5853:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1787787365.273969:0:5853:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1787787365.274077:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06010b7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694467712:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787787365.274141:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787365.274382:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707091a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+13:10449:x1874630678716672:12345-192.168.206.10@tcp:44:lhsmtool_posix.0 Request processed in 51898us (54329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787365.274399:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 80 00000100:00100000:0.0:1787787365.274853:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694467712 00000100:00100000:0.0:1787787365.274860:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694467712 00000100:00100000:0.0:1787787365.275031:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787787365.275042:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694467712:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787787365.275202:0:6674:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787787365.275206:0:6674:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787787365 00002000:00010000:0.0:1787787365.275208:0:6674:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787787365.275210:0:6674:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787787364 -> 1787787365 00002000:00010000:0.0:1787787365.275329:0:6674:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787787365.275389:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3291:x1874630694467712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 349us (1248us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787787365.275396:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:3.0:1787787365.275484:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d06010b7840/2, rc 0, transno 4294967303 00000100:00100000:3.0:1787787365.275491:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06010b7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694467712:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787787365.279016:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787365.279095:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678716800 00000100:00100000:1.0:1787787365.279105:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678716800 00000100:00100000:1.0:1787787365.279160:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 30 00000100:00100000:1.0:1787787365.279170:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06020eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+8:2342:x1874630678716800:12345-192.168.206.10@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787787365.319804:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06020eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+8:2342:x1874630678716800:12345-192.168.206.10@tcp:16:lhsmtool_posix.0 Request processed in 40626us (40788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787365.319818:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 30 00000001:00080000:0.0:1787787365.319854:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1787787365.319864:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1787787365.335930:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787365.336172:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678717056 00000100:00100000:3.0:1787787365.336181:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678717056 00000100:00100000:3.0:1787787365.336732:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 81 00000100:00100000:3.0:1787787365.336744:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06020e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+13:10449:x1874630678717056:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787787365.336792:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787365.336816:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1634 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35158 expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787365.336834:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d07078d0600) 00010000:00010000:3.0:1787787365.336839:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787787365.336865:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1649 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787365.336877:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1649 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787365.336887:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1649 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787787365.337517:0:5820:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000081629816 reply state 000000003cf51fd3 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1649 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787365.337529:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787787365.337672:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06020e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+14:10449:x1874630678717056:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 928us (1747us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1787787365.337689:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 81 00010000:00010000:2.0:1787787365.343928:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1649 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787365.343946:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1649 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787365.343954:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1649 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787365.343961:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708770200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787365.343966:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1649 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787365.343974:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1649 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787365.343990:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d07078d0600) 00010000:00010000:2.0:1787787365.343994:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787365.343998:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1649 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787365.344005:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1649 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787365.344819:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787365.344930:0:10776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678717184 00000100:00100000:2.0:1787787365.344939:0:10776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678717184 00000100:00100000:2.0:1787787365.344992:0:10776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 31 00000100:00100000:2.0:1787787365.345001:0:10776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06020e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2345:x1874630678717184:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787787365.345261:0:10776:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787787365.345265:0:10776:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787787365 -> 1787787363 00002000:00010000:2.0:1787787365.345267:0:10776:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787787362 00002000:00010000:2.0:1787787365.345270:0:10776:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787787365 -> 1787787363 00002000:00010000:2.0:1787787365.345272:0:10776:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787787365.345332:0:10776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06020e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2345:x1874630678717184:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 Request processed in 331us (710us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787787365.345341:0:10776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 31 00000100:00100000:0.0:1787787365.348094:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787365.348159:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678717440 00000100:00100000:3.0:1787787365.348168:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678717440 00000100:00100000:3.0:1787787365.348226:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 82 00000100:00100000:3.0:1787787365.348237:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06020e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+13:10449:x1874630678717440:12345-192.168.206.10@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787787365.348302:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1650 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787365.348320:0:9687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1611 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3514a expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787365.348336:0:9687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1650 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787365.348370:0:9687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1611 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3514a expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787365.348383:0:9687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1611 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3514a expref: 13 pid: 5821 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787365.348398:0:9687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07185a0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9687:1874630694467840:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787787365.348519:0:9687:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d072daf5480 going to sleep for 11 seconds 00000100:00100000:0.0:1787787365.351078:0:9687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07185a0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9687:1874630694467840:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787787365.351106:0:9687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1650 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787365.351700:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787365.352124:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678717568 00000100:00100000:3.0:1787787365.352131:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678717568 00010000:00010000:3.0:1787787365.352230:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1611 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3514a expref: 14 pid: 5821 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787365.352332:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 43 00000100:00100000:3.0:1787787365.352343:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06020eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+14:2344:x1874630678717568:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787365.352357:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787365.352365:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1611 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3514a expref: 14 pid: 5821 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787365.352377:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1611 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3514a expref: 14 pid: 5821 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787365.352398:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1611 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3514a expref: 14 pid: 5821 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787365.352413:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d07078d0600) 00010000:00010000:3.0:1787787365.352418:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1650 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787365.352427:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1650 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787365.352435:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1650 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787365.352486:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787365.352556:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06020eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+13:2344:x1874630678717568:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 214us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787365.352564:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 43 00010000:00010000:0.0:1787787365.352618:0:9687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1650 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.352625:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1650 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.352651:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1650 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.352658:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1650 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.352674:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1650 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.352680:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708770800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787365.352685:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1650 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.352692:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1650 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.352702:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d07078d0600) 00010000:00010000:0.0:1787787365.352705:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787787365.352708:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1650 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.352715:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1650 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787365.352751:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06020e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+12:10449:x1874630678717440:12345-192.168.206.10@tcp:55:lhsmtool_posix.0 Request processed in 4517us (4666us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787787365.352759:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 82 00000100:00100000:3.0:1787787365.356157:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787365.356950:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678717696 00000100:00100000:2.0:1787787365.356960:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678717696 00000100:00100000:2.0:1787787365.357016:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 32 00000100:00100000:2.0:1787787365.357025:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07185a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2342:x1874630678717696:12345-192.168.206.10@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787787365.357062:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000090a1d2c9/0xdeb1953cba4b1657 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787365.357080:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000030798ded/0xdeb1953cba4b1642 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35166 expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787365.357089:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787365.357093:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787787365.357098:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090a1d2c9/0xdeb1953cba4b1657 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787365.357127:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000030798ded/0xdeb1953cba4b1642 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35166 expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787365.357270:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000030798ded/0xdeb1953cba4b1642 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35166 expref: 7 pid: 6673 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787365.357285:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06010b6940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6673:1874630694467968:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787787365.357361:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0737e79180 going to sleep for 11 seconds 00000100:00100000:2.0:1787787365.361097:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787365.361219:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678717824 00000100:00100000:0.0:1787787365.361227:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678717824 00010000:00010000:0.0:1787787365.361265:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000030798ded/0xdeb1953cba4b1642 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35166 expref: 8 pid: 6673 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787365.361364:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 44 00000100:00100000:0.0:1787787365.361373:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+8:2344:x1874630678717824:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787365.361401:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787365.361421:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000030798ded/0xdeb1953cba4b1642 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35166 expref: 8 pid: 6673 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.361461:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000030798ded/0xdeb1953cba4b1642 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35166 expref: 8 pid: 6673 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787365.361474:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06010b6940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6673:1874630694467968:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787787365.361484:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030798ded/0xdeb1953cba4b1642 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35166 expref: 8 pid: 6673 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787365.361495:0:6673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000090a1d2c9/0xdeb1953cba4b1657 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.361498:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787787365.361512:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787787365.361518:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000090a1d2c9/0xdeb1953cba4b1657 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.361528:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090a1d2c9/0xdeb1953cba4b1657 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.361547:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787787365.361556:0:6673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000090a1d2c9/0xdeb1953cba4b1657 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787365.361563:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090a1d2c9/0xdeb1953cba4b1657 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787365.361585:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000090a1d2c9/0xdeb1953cba4b1657 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787365.361591:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2344:x1874630678717824:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 219us (503us total) trans 0 rc 0/0 00010000:00010000:3.0:1787787365.361594:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090a1d2c9/0xdeb1953cba4b1657 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787365.361598:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 44 00010000:00010000:3.0:1787787365.361602:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090a1d2c9/0xdeb1953cba4b1657 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787365.361609:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd38200 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787365.361612:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090a1d2c9/0xdeb1953cba4b1657 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787365.361621:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090a1d2c9/0xdeb1953cba4b1657 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787365.361647:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090a1d2c9/0xdeb1953cba4b1657 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787365.361654:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090a1d2c9/0xdeb1953cba4b1657 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787365.361700:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07185a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2342:x1874630678717696:12345-192.168.206.10@tcp:1:lhsmtool_posix.0 Request processed in 4676us (5559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787365.362028:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 32 00000100:00100000:3.0:1787787365.364664:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787365.364934:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678718080 00000100:00100000:0.0:1787787365.364943:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678718080 00000100:00100000:0.0:1787787365.365028:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 83 00000100:00100000:0.0:1787787365.365038:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070596ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+12:10449:x1874630678718080:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787787365.365124:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b165e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.365140:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b165e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.365164:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b165e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.365479:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1665 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.365491:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b161f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35151 expref: 13 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.365499:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1665 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.365543:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b161f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35151 expref: 13 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.365557:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b161f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35151 expref: 13 pid: 9687 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787365.365570:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06020e9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5819:1874630694468096:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787787365.365732:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073d9bc300 going to sleep for 11 seconds 00000100:00100000:2.0:1787787365.368648:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787365.368742:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06020e9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5819:1874630694468096:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787787365.368774:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1665 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787365.369840:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678718208 00000100:00100000:0.0:1787787365.369851:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678718208 00010000:00010000:0.0:1787787365.369898:0:8496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b161f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35151 expref: 14 pid: 9687 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787365.369959:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 45 00000100:00100000:0.0:1787787365.369969:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+14:2344:x1874630678718208:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787365.369996:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787365.370004:0:8496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b161f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35151 expref: 14 pid: 9687 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.370837:0:8496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b161f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35151 expref: 14 pid: 9687 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.370863:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b161f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35151 expref: 14 pid: 9687 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.370878:0:8496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d07078d0600) 00010000:00010000:0.0:1787787365.370883:0:8496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1665 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.370892:0:8496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1665 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.370900:0:8496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1665 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.370935:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787787365.370997:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1665 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.371006:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1665 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787787365.371181:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000100:00100000:0.0:1787787365.371191:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+14:2344:x1874630678718208:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 1220us (2548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787365.371201:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 45 00000001:00080000:1.0:1787787365.371318:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1787787365.372086:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1787787365.372180:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fefcf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5819:1874630694468224:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787787365.373297:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787365.373363:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694468224 00000100:00100000:2.0:1787787365.373372:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694468224 00000100:00100000:1.0:1787787365.373428:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073476e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787365.373429:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787787365.373472:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fefc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5819:x1874630694468224:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787787365.373591:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fefc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5819:x1874630694468224:12345-0@lo:1000:mdt00_000.0 Request processed in 121us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787365.373598:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787787365.373766:0:5819:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1787787365.373771:0:5819:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d06010b7840, transno 4294967303 00000100:00100000:1.0:1787787365.373841:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fefcf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5819:1874630694468224:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1787787365.374718:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1787787365.374786:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fefcf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5819:1874630694468352:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787787365.374842:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787365.374871:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073476e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787365.374913:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694468352 00000100:00100000:3.0:1787787365.374920:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694468352 00000100:00100000:3.0:1787787365.374961:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787787365.374969:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073feff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5819:x1874630694468352:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787787365.375179:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073feff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5819:x1874630694468352:12345-0@lo:1000:mdt00_000.0 Request processed in 209us (334us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787787365.375188:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787787365.376022:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fefcf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5819:1874630694468352:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1787787365.376060:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1665 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.376070:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1665 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.376077:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1665 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.376083:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fcc00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787365.376087:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1665 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.376094:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1665 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.376108:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d07078d0600) 00010000:00010000:1.0:1787787365.376118:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787787365.376193:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1665 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.376200:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1665 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.376246:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b1593 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.376251:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b1593 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.376257:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b1593 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.376262:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212a600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787365.376265:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b1593 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.376270:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b1593 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.376278:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07114ac400) 00010000:00010000:1.0:1787787365.376280:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787787365.376282:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b1593 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.376287:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b1593 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.376306:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b166c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.376327:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b15af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35135 expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.376404:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b166c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.376433:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b15af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35135 expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.376481:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b15af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35135 expref: 16 pid: 5819 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787365.376494:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073c76f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5819:1874630694468480:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787787365.376574:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073476e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787365.380152:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787365.380358:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073c76f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5819:1874630694468480:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787787365.380383:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b166c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787365.382772:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678718336 00000100:00100000:0.0:1787787365.383064:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678718336 00010000:00010000:0.0:1787787365.383109:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b15af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35135 expref: 17 pid: 5819 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787365.383216:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 46 00000100:00100000:0.0:1787787365.383227:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+17:2344:x1874630678718336:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787365.383243:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787365.383249:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b15af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35135 expref: 17 pid: 5819 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.383277:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b15af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35135 expref: 17 pid: 5819 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.383299:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b15af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35135 expref: 17 pid: 5819 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.383315:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07114ac400) 00010000:00010000:0.0:1787787365.383320:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b166c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.383330:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b166c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.383338:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b166c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787365.383372:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787365.383474:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+16:2344:x1874630678718336:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 247us (3329us total) trans 0 rc 0/0 00010000:00010000:1.0:1787787365.383475:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b166c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.383488:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b166c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787365.383517:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 46 00010000:00010000:1.0:1787787365.383584:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b166c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.383592:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b166c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.383599:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b166c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.383617:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212aa00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787365.383622:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b166c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.383629:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b166c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.383639:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07114ac400) 00010000:00010000:1.0:1787787365.383642:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787365.383646:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b166c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.383652:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b166c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.383664:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b165e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.383671:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b165e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.383676:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b165e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.383681:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fd400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787365.383685:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b165e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.383690:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b165e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.383710:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07114ac400) 00010000:00010000:1.0:1787787365.383712:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787787365.383715:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b165e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.383721:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b165e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787365.383980:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070596ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+15:10449:x1874630678718080:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 18942us (19324us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1787787365.383989:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 83 00000020:00080000:1.0:1787787365.383993:0:5819:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787787365.385361:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787787365.385370:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787787365.385404:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787787365.385411:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787787365.388832:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787365.391766:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678718592 00000100:00100000:3.0:1787787365.391781:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678718592 00000100:00100000:3.0:1787787365.391854:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 20 00000100:00100000:3.0:1787787365.391864:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+15:10449:x1874630678718592:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787787365.392745:0:5822:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787787365.392845:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1787787365.392890:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1673 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787365.392907:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1673 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787365.392918:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1673 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787365.392927:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1673 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787365.392934:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1673 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787365.392941:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1673 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787365.392967:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787787365.393061:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+17:10449:x1874630678718592:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 1195us (4238us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1787787365.393071:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 20 00000020:00080000:3.0:1787787365.393076:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787787365.393199:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787365.393208:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1673 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.393217:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708770200 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:1.0:1787787365.393221:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1673 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.393230:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1673 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.393244:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d071b71d200) 00010000:00010000:1.0:1787787365.393248:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787787365.393253:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1673 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.393259:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1673 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787365.393290:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787365.393292:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787365.393294:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787366.012753:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787366.268679:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787787366.268701:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06010b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694468608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787787366.268767:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787366.269170:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694468608 00000100:00100000:2.0:1787787366.269178:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694468608 00000100:00100000:2.0:1787787366.269245:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787787366.269255:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070596f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3291:x1874630694468608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787787366.269290:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1787787366.269347:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070596f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3291:x1874630694468608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787366.269353:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787787366.269509:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06010b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694468608:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787787366.269714:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1787787366.407590:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787787366.407610:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787787366.407655:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787787366.407661:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787787366.995640:0:12039:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787787366.995650:0:12039:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787787366.995686:0:12039:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787787366.995692:0:12039:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787787367.036979:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787367.198723:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787367.199185:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678718848 00000100:00100000:3.0:1787787367.199196:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678718848 00000100:00100000:3.0:1787787367.199261:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 84 00000100:00100000:3.0:1787787367.199271:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06020eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+17:10468:x1874630678718848:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787787367.199295:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787367.199329:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b167a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3516d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787367.199586:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b1681 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787367.199601:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b1681 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787367.199611:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b1681 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787367.199621:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787787367.199770:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b167a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3516d expref: 20 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787367.199784:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b1681 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3516d expref: 19 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787367.199792:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d07078d0f00) 00010000:00010000:3.0:1787787367.199795:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787787367.199803:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708771e00, rc 0) 00000100:00100000:3.0:1787787367.199857:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06020eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+19:10468:x1874630678718848:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 587us (1140us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1787787367.199864:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 84 00000100:00080000:3.0:1787787367.199886:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787367.205658:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787367.205734:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678718976 00000100:00100000:3.0:1787787367.205743:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678718976 00000100:00100000:3.0:1787787367.205799:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 85 00000100:00100000:3.0:1787787367.205809:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+19:10468:x1874630678718976:12345-192.168.206.10@tcp:34:lfs.0 00010000:00010000:3.0:1787787367.205880:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b168f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787367.206541:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b168f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787367.206556:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b168f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787367.206575:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1696 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787367.206583:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1696 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787367.206589:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1696 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.207206:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b169d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.207218:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b169d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.207226:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b169d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787787367.207267:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b169d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.207280:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b168f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.207287:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b168f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.207294:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b168f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.207300:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708770000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787367.207304:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b168f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.207311:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b168f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.207334:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d07078d0f00) 00010000:00010000:1.0:1787787367.207337:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787367.207341:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b168f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.207347:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770000/0xdeb1953cba4b168f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.207358:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1696 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.207365:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1696 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.207370:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1696 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.207376:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708771800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787367.207378:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1696 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.207384:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1696 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.207392:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d071b71d700) 00010000:00010000:1.0:1787787367.207394:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787367.207397:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1696 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.207403:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1696 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.207427:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b169d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.207434:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b169d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.207467:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b169d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.207472:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212a600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787367.207475:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b169d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.207481:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b169d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.207489:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07114ac400) 00010000:00010000:1.0:1787787367.207503:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787367.207507:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b169d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.207513:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b169d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787367.207599:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+19:10468:x1874630678718976:12345-192.168.206.10@tcp:34:lfs.0 Request processed in 1788us (1946us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787367.207607:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 85 00000100:00100000:3.0:1787787367.268618:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787367.268725:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678719232 00000100:00100000:0.0:1787787367.268735:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678719232 00000100:00100000:0.0:1787787367.268799:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 86 00000100:00100000:0.0:1787787367.268810:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070596fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+19:10471:x1874630678719232:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787787367.268833:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787367.268855:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc800/0xdeb1953cba4b16a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35174 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.269050:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b16ab lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.269064:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b16ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.269076:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b16ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.269090:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b16b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.269097:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b16b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.269122:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b16b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.269699:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b16b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.269709:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b16b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.269724:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b16b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787367.269733:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787787367.269820:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b16ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.269828:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b16ab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.269834:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b16ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.269841:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fce00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787367.269845:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b16ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.269852:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b16ab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.269863:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d07078d0f00) 00010000:00010000:1.0:1787787367.269866:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787367.269870:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b16ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.269875:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b16ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.269891:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b16b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.269897:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b16b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.269909:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b16b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.269914:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fc000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787367.269916:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b16b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.269923:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b16b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.269931:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d07096a0e00) 00010000:00010000:1.0:1787787367.269934:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787367.269937:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b16b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.269956:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b16b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.269999:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc800/0xdeb1953cba4b16a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35174 expref: 22 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.270013:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b16b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35174 expref: 21 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.270020:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07114ac400) 00010000:00010000:1.0:1787787367.270021:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787787367.270024:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d072212a600, rc 0) 00000100:00100000:1.0:1787787367.270089:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070596fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+21:10471:x1874630678719232:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 1281us (1480us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1787787367.270107:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 86 00000100:00100000:1.0:1787787367.276678:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787367.276759:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678719360 00000100:00100000:2.0:1787787367.276769:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678719360 00000100:00100000:2.0:1787787367.276823:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 87 00000100:00100000:2.0:1787787367.276832:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073c76f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+21:10471:x1874630678719360:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:2.0:1787787367.276897:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b16c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787367.276921:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b16c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787367.276931:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b16c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787367.276969:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b16c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787367.276977:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b16c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787367.276983:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b16c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787367.276989:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd38600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787367.276993:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b16c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787367.277019:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b16c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787367.277031:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07114ac400) 00010000:00010000:2.0:1787787367.277034:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787787367.277039:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b16c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787367.277046:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b16c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787367.277399:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073c76f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+21:10471:x1874630678719360:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 566us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787367.277409:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 87 00000100:00100000:2.0:1787787367.282642:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787367.282761:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678719616 00000100:00100000:1.0:1787787367.282771:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678719616 00000100:00100000:1.0:1787787367.282834:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 21 00000100:00100000:1.0:1787787367.282843:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703165c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+21:10471:x1874630678719616:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:1.0:1787787367.283081:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703165c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+22:10471:x1874630678719616:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 239us (447us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1787787367.283094:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 21 00000100:00100000:3.0:1787787367.326814:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787367.326978:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678719872 00000100:00100000:0.0:1787787367.326987:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678719872 00000100:00100000:0.0:1787787367.327047:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 88 00000100:00100000:0.0:1787787367.327057:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070596e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+22:9991:x1874630678719872:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:0.0:1787787367.327081:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787367.327100:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b16ce lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3517b expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.327221:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fda00/0xdeb1953cba4b16d5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.327237:0:9687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b16b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35174 expref: 23 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.327246:0:9687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fda00/0xdeb1953cba4b16d5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.327276:0:9687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b16b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35174 expref: 23 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.327288:0:9687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b16b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35174 expref: 23 pid: 5821 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787367.327302:0:9687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06020ebc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9687:1874630694468736:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787787367.327412:0:9687:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073d9bcb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787787367.335479:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787367.335572:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678720000 00000100:00100000:3.0:1787787367.335580:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678720000 00010000:00010000:3.0:1787787367.335711:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b16b9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35174 expref: 24 pid: 5821 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787367.335784:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 47 00000100:00100000:3.0:1787787367.335795:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+24:2345:x1874630678720000:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787367.335817:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787367.335824:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b16b9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35174 expref: 24 pid: 5821 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787367.335837:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b16b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35174 expref: 24 pid: 5821 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787367.335858:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07114ac400) 00010000:00010000:3.0:1787787367.335863:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fda00/0xdeb1953cba4b16d5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787367.335872:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fda00/0xdeb1953cba4b16d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787367.335886:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fda00/0xdeb1953cba4b16d5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787367.335905:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787367.335959:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+24:2345:x1874630678720000:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 166us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787367.335966:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 47 00010000:00010000:0.0:1787787367.337617:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b16b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35174 expref: 23 pid: 5821 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787367.337641:0:9687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06020ebc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9687:1874630694468736:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787787367.337662:0:9687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fda00/0xdeb1953cba4b16d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.337671:0:9687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fda00/0xdeb1953cba4b16d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.337676:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fda00/0xdeb1953cba4b16d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787367.337693:0:9687:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787787367.337847:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b16ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3517b expref: 24 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.337868:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fda00/0xdeb1953cba4b16d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3517b expref: 23 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.337876:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07114ac400) 00010000:00010000:0.0:1787787367.337878:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787787367.337881:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d07059fda00, rc 0) 00000100:00100000:0.0:1787787367.337943:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070596e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+23:9991:x1874630678719872:12345-192.168.206.10@tcp:101:bash.0 Request processed in 10888us (11137us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1787787367.337951:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 88 00000100:00100000:2.0:1787787367.348116:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787367.351500:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678720256 00000100:00100000:1.0:1787787367.351517:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678720256 00000100:00100000:1.0:1787787367.351591:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 89 00000100:00100000:1.0:1787787367.351601:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+23:9991:x1874630678720256:12345-192.168.206.10@tcp:36:bash.0 00010000:00010000:1.0:1787787367.351847:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b16e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.351863:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b16e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.351874:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b16e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787787367.351926:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1787787367.351950:0:5819:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b098381 reply state 00000000e882dc21 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b16e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787367.351959:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787787367.352005:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1787787367.352137:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+27:9991:x1874630678720256:12345-192.168.206.10@tcp:36:bash.0 Request processed in 536us (4028us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1787787367.352145:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 89 00000020:00080000:1.0:1787787367.352149:0:5819:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1787787367.355682:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b16e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.355722:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b16e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.355731:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b16e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.355737:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212aa00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787367.355742:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b16e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.355750:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b16e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.355766:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07114ac400) 00010000:00010000:0.0:1787787367.355769:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787367.355774:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b16e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.355780:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b16e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787367.357831:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787367.361242:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678720384 00000100:00100000:1.0:1787787367.361255:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678720384 00000100:00100000:1.0:1787787367.361321:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 90 00000100:00100000:1.0:1787787367.361330:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+26:9991:x1874630678720384:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:1.0:1787787367.361354:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787367.361372:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b800/0xdeb1953cba4b16ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35182 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.361429:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b800/0xdeb1953cba4b16ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35182 expref: 27 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.361475:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b800/0xdeb1953cba4b16ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35182 expref: 27 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.361504:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07114ac400) 00010000:00010000:1.0:1787787367.361507:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787787367.361510:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d072212b800, rc 0) 00000100:00100000:1.0:1787787367.361571:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+27:9991:x1874630678720384:12345-192.168.206.10@tcp:101:bash.0 Request processed in 242us (3749us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787367.361578:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 90 00000100:00100000:2.0:1787787367.366480:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787367.366575:0:10776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678720512 00000100:00100000:0.0:1787787367.366585:0:10776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678720512 00000100:00100000:0.0:1787787367.366660:0:10776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 33 00000100:00100000:0.0:1787787367.366669:0:10776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+6:9991:x1874630678720512:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:0.0:1787787367.366686:0:10776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787367.366705:0:10776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3e28d15/0xdeb1953cba4b16f1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35189 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787787367.366729:0:10776:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8f7863, atime: 0x6a8f7862, ctime: 0x6a8f7863, blocks: 0xb 00010000:00010000:0.0:1787787367.366763:0:10776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=279s v=(0 0) 00010000:00010000:0.0:1787787367.366767:0:10776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787367.366775:0:10776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3e28d15/0xdeb1953cba4b16f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35189 expref: 7 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.366794:0:10776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3e28d15/0xdeb1953cba4b16f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35189 expref: 7 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.366805:0:10776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d07059fc200, rc 0) 00000100:00100000:0.0:1787787367.366861:0:10776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+7:9991:x1874630678720512:12345-192.168.206.10@tcp:101:bash.0 Request processed in 193us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787367.366868:0:10776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 33 00000100:00080000:3.0:1787787367.367523:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787787367.369549:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787367.369642:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678720640 00000100:00100000:2.0:1787787367.369651:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678720640 00002000:00010000:2.0:1787787367.369683:0:6678:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1787787367.369688:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d0707a08780 with x1874630678720640 ext(0->18446744073709551615) 00002000:00010000:2.0:1787787367.369697:0:6678:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d0707a08780. 00000100:00100000:2.0:1787787367.369727:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00100000:2.0:1787787367.369736:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a08780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2345:x1874630678720640:12345-192.168.206.10@tcp:10:bash.0 00002000:00010000:2.0:1787787367.369984:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787787367.369998:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787787363 -> 1787787367 00002000:00010000:2.0:1787787367.370001:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1787787362 -> 1787787362 00002000:00010000:2.0:1787787367.370003:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787787363 -> 1787787367 00002000:00010000:2.0:1787787367.370005:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787787367.370252:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a08780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+8:2345:x1874630678720640:12345-192.168.206.10@tcp:10:bash.0 Request processed in 515us (710us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787787367.370261:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 1 00002000:00010000:2.0:1787787367.370265:0:6678:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1787787367.370268:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d0707a08780 with x1874630678720640 ext(0->18446744073709551615) 00002000:00010000:2.0:1787787367.370272:0:6678:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d0707a08780. 00000100:00100000:2.0:1787787367.399339:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787367.399386:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787367.399470:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678720896 00000100:00100000:1.0:1787787367.399479:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678720896 00000100:00100000:1.0:1787787367.399538:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 34 00000100:00100000:1.0:1787787367.399547:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+8:2342:x1874630678720896:12345-192.168.206.10@tcp:16:kworker.0 00000100:00100000:0.0:1787787367.400801:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678720768 00000100:00100000:0.0:1787787367.400811:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678720768 00002000:00100000:0.0:1787787367.400848:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->7) req@ffff9d06010b5e00 x1874630678720768/t0(0) o4->c5599457-aa74-4a71-951f-faabe33e6ec7@192.168.206.10@tcp:228/0 lens 496/0 e 0 to 0 dl 1787787378 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787787367.400860:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d06010b5e00 with x1874630678720768 ext(0->7) 00002000:00010000:0.0:1787787367.400865:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d06010b5e00 00000100:00100000:0.0:1787787367.400895:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:0.0:1787787367.400904:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+9:2342:x1874630678720768:12345-192.168.206.10@tcp:4:bash.0 00000100:00100000:0.0:1787787367.401584:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+11:2342:x1874630678720768:12345-192.168.206.10@tcp:4:bash.0 Request processed in 678us (2249us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787787367.401592:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 2 00002000:00100000:0.0:1787787367.401601:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->7) req@ffff9d06010b5e00 x1874630678720768/t4294967307(0) o4->c5599457-aa74-4a71-951f-faabe33e6ec7@192.168.206.10@tcp:228/0 lens 496/448 e 0 to 0 dl 1787787378 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787787367.401952:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d06010b5e00 with x1874630678720768 ext(0->7) 00002000:00010000:0.0:1787787367.401960:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d06010b5e00 00000001:00080000:0.0:1787787367.478471:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:0.0:1787787367.478507:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:1.0:1787787367.478723:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2342:x1874630678720896:12345-192.168.206.10@tcp:16:kworker.0 Request processed in 79172us (79331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787367.478735:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 34 00000100:00100000:3.0:1787787367.496679:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787367.497035:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678721024 00000100:00100000:1.0:1787787367.497044:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678721024 00000100:00100000:1.0:1787787367.497099:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 91 00000100:00100000:1.0:1787787367.497118:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+27:10485:x1874630678721024:12345-192.168.206.10@tcp:34:lfs.0 00010000:00010000:1.0:1787787367.497290:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b16f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.497307:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b16f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.497318:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b16f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.497331:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b16ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.497338:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b16ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.497344:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b16ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.497791:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b1706 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.497801:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b1706 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.497819:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b1706 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787787367.497857:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b1706 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.497868:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b16f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.497873:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b16f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.498062:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b16f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.498068:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212b000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787367.498073:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b16f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.498079:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b16f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.498091:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d07078d0f00) 00010000:00010000:1.0:1787787367.498094:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787367.498099:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b16f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.498105:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b16f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.498127:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b16ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.498252:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b16ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.498258:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b16ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.498263:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212ba00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787367.498267:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b16ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.498272:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b16ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.498280:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d07114ac800) 00010000:00010000:1.0:1787787367.498283:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787367.498286:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b16ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.498292:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b16ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.498306:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b1706 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.498312:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b1706 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.498317:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b1706 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.498322:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212aa00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787367.498330:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b1706 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.498336:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b1706 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.498344:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07114ac400) 00010000:00010000:1.0:1787787367.498347:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787367.498349:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b1706 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.498355:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b1706 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787367.498530:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+27:10485:x1874630678721024:12345-192.168.206.10@tcp:34:lfs.0 Request processed in 1420us (1858us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787367.498539:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 91 00000100:00100000:3.0:1787787367.566591:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787367.566705:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678721280 00000100:00100000:1.0:1787787367.566717:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678721280 00000100:00100000:1.0:1787787367.566776:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 92 00000100:00100000:1.0:1787787367.566784:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+27:10488:x1874630678721280:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787787367.566804:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787367.566826:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b170d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35190 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.566907:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b1714 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.566921:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b1714 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.566944:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b1714 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.566960:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b171b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.566967:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b171b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.566974:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b171b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.567311:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b1722 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.567321:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b1722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.567329:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b1722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787367.567339:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787787367.567427:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b1714 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.567435:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b1714 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.567476:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b1714 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.567483:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212ba00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787367.567504:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b1714 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.567513:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b1714 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.567526:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d07078d0f00) 00010000:00010000:1.0:1787787367.567529:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787367.567533:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b1714 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.567539:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b1714 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.567551:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b171b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.567557:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b171b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.567563:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b171b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.567568:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212b000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787367.567571:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b171b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.567577:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b171b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.567584:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d07114ac800) 00010000:00010000:1.0:1787787367.567586:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787367.567596:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b171b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.567602:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b171b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.567640:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b170d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35190 expref: 30 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.567654:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b1722 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35190 expref: 29 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.567661:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07114ac400) 00010000:00010000:1.0:1787787367.567663:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787787367.567665:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d072212a600, rc 0) 00000100:00100000:1.0:1787787367.567731:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+29:10488:x1874630678721280:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 948us (1151us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1787787367.567739:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 92 00000100:00100000:3.0:1787787367.576159:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787367.576398:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678721408 00000100:00100000:2.0:1787787367.576408:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678721408 00000100:00100000:2.0:1787787367.576507:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 93 00000100:00100000:2.0:1787787367.576518:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+29:10488:x1874630678721408:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:2.0:1787787367.578074:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1730 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787367.578098:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fda00/0xdeb1953cba4b16d5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3517b expref: 29 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787367.578107:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1730 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787367.578141:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fda00/0xdeb1953cba4b16d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3517b expref: 29 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787367.578174:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fda00/0xdeb1953cba4b16d5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3517b expref: 29 pid: 9687 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787367.578189:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06010b70c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1874630694468864:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787787367.578292:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0703830c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787787367.585913:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787367.585999:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678721664 00000100:00100000:0.0:1787787367.586008:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678721664 00000100:00100000:0.0:1787787367.586081:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 22 00000100:00100000:0.0:1787787367.586090:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+30:5580:x1874630678721664:12345-192.168.206.10@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787787367.586399:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+31:5580:x1874630678721664:12345-192.168.206.10@tcp:35:ldlm_bl.0 Request processed in 309us (493us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1787787367.586407:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 22 00000100:00100000:2.0:1787787367.589344:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06010b70c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1874630694468864:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787787367.589374:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1730 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787367.594567:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787367.594674:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678721792 00000100:00100000:0.0:1787787367.594683:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678721792 00010000:00010000:0.0:1787787367.594722:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fda00/0xdeb1953cba4b16d5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3517b expref: 31 pid: 9687 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787367.594766:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 48 00000100:00100000:0.0:1787787367.594776:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+31:2345:x1874630678721792:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787367.594789:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787367.594797:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fda00/0xdeb1953cba4b16d5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3517b expref: 31 pid: 9687 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.594811:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fda00/0xdeb1953cba4b16d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3517b expref: 31 pid: 9687 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.594851:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fda00/0xdeb1953cba4b16d5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3517b expref: 31 pid: 9687 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.594866:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07114ac400) 00010000:00010000:0.0:1787787367.594871:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1730 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.594881:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1730 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.594888:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1730 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.594929:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787367.594979:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+30:2345:x1874630678721792:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 204us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787367.594986:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 48 00010000:00010000:2.0:1787787367.595433:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1730 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787367.595483:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1730 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787367.595522:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1730 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787367.595530:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1730 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787367.595536:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1730 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787367.595542:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd38800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787367.595547:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1730 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787367.595554:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1730 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787367.595573:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07114ac400) 00010000:00010000:2.0:1787787367.595576:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787787367.595579:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1730 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787367.595586:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1730 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787367.595630:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+29:10488:x1874630678721408:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 19112us (19489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787367.595637:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 93 00000100:00100000:3.0:1787787367.597539:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787367.598578:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678722048 00000100:00100000:0.0:1787787367.598590:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678722048 00000100:00100000:0.0:1787787367.598662:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 23 00000100:00100000:0.0:1787787367.598671:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+29:10488:x1874630678722048:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:0.0:1787787367.598882:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+30:10488:x1874630678722048:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 211us (1350us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1787787367.598890:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 23 00000100:00100000:3.0:1787787367.690798:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787367.690909:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678722304 00000100:00100000:1.0:1787787367.690919:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678722304 00000100:00100000:1.0:1787787367.690978:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 94 00000100:00100000:1.0:1787787367.690988:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+30:10499:x1874630678722304:12345-192.168.206.10@tcp:101:cat.0 00010000:00010000:1.0:1787787367.691011:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787367.691042:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b1737 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35197 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.691118:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b173e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.691153:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b173e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.691163:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b173e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.691176:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b1745 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.691181:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b1745 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.691185:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b1745 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.691535:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ac00/0xdeb1953cba4b174c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.691544:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ac00/0xdeb1953cba4b174c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.691550:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ac00/0xdeb1953cba4b174c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787367.691558:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1787787367.691641:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b173e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.691649:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b173e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.691655:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b173e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.691667:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212b000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787367.691671:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b173e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.691679:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b173e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.691696:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d07078d0f00) 00010000:00010000:1.0:1787787367.691699:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787367.691703:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b173e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.691709:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b173e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.691721:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b1745 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.691727:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b1745 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.691733:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b1745 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.691738:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212ba00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787367.691740:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b1745 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.691745:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b1745 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.691762:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d07114ac800) 00010000:00010000:1.0:1787787367.691765:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787367.691767:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b1745 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.691773:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b1745 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.691822:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b1737 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35197 expref: 33 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.691846:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ac00/0xdeb1953cba4b174c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35197 expref: 32 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.691853:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07114ac400) 00010000:00010000:1.0:1787787367.691855:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787787367.691858:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d072212ac00, rc 0) 00000100:00100000:1.0:1787787367.691919:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+32:10499:x1874630678722304:12345-192.168.206.10@tcp:101:cat.0 Request processed in 932us (1129us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1787787367.691927:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 94 00000100:00100000:3.0:1787787367.696987:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787367.697800:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678722560 00000100:00100000:0.0:1787787367.697810:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678722560 00000100:00100000:0.0:1787787367.697922:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 24 00000100:00100000:0.0:1787787367.697949:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+32:10499:x1874630678722560:12345-192.168.206.10@tcp:35:cat.0 00000100:00100000:0.0:1787787367.698192:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+33:10499:x1874630678722560:12345-192.168.206.10@tcp:35:cat.0 Request processed in 245us (1223us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1787787367.698200:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 24 00000100:00100000:3.0:1787787367.734797:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787367.735127:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678722816 00000100:00100000:1.0:1787787367.735136:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678722816 00000100:00100000:1.0:1787787367.735199:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 95 00000100:00100000:1.0:1787787367.735209:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+33:10500:x1874630678722816:12345-192.168.206.10@tcp:36:rm.0 00010000:00010000:1.0:1787787367.735286:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787787367.735311:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ac00/0xdeb1953cba4b174c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35197 expref: 33 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.735346:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a600/0xdeb1953cba4b1722 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35190 expref: 32 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.735358:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b800/0xdeb1953cba4b16ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35182 expref: 31 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.735367:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07114ac400) 00010000:00010000:1.0:1787787367.735376:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787787367.735395:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b175a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.735407:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b175a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.735414:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b175a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.735427:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b1761 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.735432:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b1761 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.735533:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b1761 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.736241:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b1768 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.736252:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b1768 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.736268:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b1768 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787787367.737340:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1787787367.737351:0:5819:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 279963912693ns, next at 280963909623ns, rc = 0 00010000:00010000:1.0:1787787367.737423:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d200/0xdeb1953cba4b176f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.737811:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d200/0xdeb1953cba4b176f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.737825:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d200/0xdeb1953cba4b176f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.737834:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d200/0xdeb1953cba4b176f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.737841:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d200/0xdeb1953cba4b176f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.737846:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d200/0xdeb1953cba4b176f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.737938:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787787367.737962:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b1768 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.737969:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b1768 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.737975:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b1768 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.737987:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212b000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787367.738002:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b1768 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.738010:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b1768 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.738022:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07114ac500) 00010000:00010000:1.0:1787787367.738025:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787787367.738029:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b1768 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.738035:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b000/0xdeb1953cba4b1768 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.738052:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b175a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.738059:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b175a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.738065:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b175a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.738070:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212aa00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787367.738072:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b175a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.738078:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b175a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.738096:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d07078d0f00) 00010000:00010000:1.0:1787787367.738098:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787367.738101:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b175a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.738106:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b175a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787787367.738128:0:5819:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004822e6e9 reply state 00000000d8a9af8d transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b1761 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787367.738136:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787787367.738289:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+32:10500:x1874630678722816:12345-192.168.206.10@tcp:36:rm.0 Request processed in 3077us (3495us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1787787367.738297:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 95 00010000:00010000:2.0:1787787367.741150:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787367.741164:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d200/0xdeb1953cba4b176f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787367.741329:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1d200 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:2.0:1787787367.741334:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d200/0xdeb1953cba4b176f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787367.741343:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d200/0xdeb1953cba4b176f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787367.741358:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d07114ac500) 00010000:00010000:2.0:1787787367.741361:0:8439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787787367.741366:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d200/0xdeb1953cba4b176f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787367.741371:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d200/0xdeb1953cba4b176f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787367.741410:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787367.741412:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787367.741414:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787367.744812:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b1761 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787367.744827:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b1761 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787367.744834:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b1761 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787367.744840:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212ba00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787367.744845:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b1761 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787367.744853:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b1761 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787367.744869:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d07114ac800) 00010000:00010000:2.0:1787787367.744882:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787367.744887:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b1761 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787367.744894:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ba00/0xdeb1953cba4b1761 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787367.789901:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787367.790185:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678723072 00000100:00100000:0.0:1787787367.790194:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678723072 00000100:00100000:0.0:1787787367.790256:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 96 00000100:00100000:0.0:1787787367.790266:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+31:10506:x1874630678723072:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:0.0:1787787367.790287:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787367.790307:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd000/0xdeb1953cba4b1776 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3519e expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.790779:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd800/0xdeb1953cba4b177d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.790794:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd800/0xdeb1953cba4b177d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.791004:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd800/0xdeb1953cba4b177d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.791022:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fca00/0xdeb1953cba4b1784 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.791031:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fca00/0xdeb1953cba4b1784 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.791037:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fca00/0xdeb1953cba4b1784 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787787367.791911:0:9687:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1787787367.792074:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fda00/0xdeb1953cba4b178b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.792522:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fda00/0xdeb1953cba4b178b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.792535:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fda00/0xdeb1953cba4b178b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.792767:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd800/0xdeb1953cba4b177d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.792776:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd800/0xdeb1953cba4b177d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.792783:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd800/0xdeb1953cba4b177d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.792790:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fd800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787367.792794:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd800/0xdeb1953cba4b177d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.792864:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd800/0xdeb1953cba4b177d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.792878:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d07078d0f00) 00010000:00010000:0.0:1787787367.792881:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787367.792885:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd800/0xdeb1953cba4b177d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.792906:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd800/0xdeb1953cba4b177d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787787367.792921:0:9687:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a184c75 reply state 000000003e24240d transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fca00/0xdeb1953cba4b1784 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787367.792930:0:9687:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787787367.792964:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd000/0xdeb1953cba4b1776 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3519e expref: 34 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.792978:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fda00/0xdeb1953cba4b178b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3519e expref: 33 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.792986:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07096a0100) 00010000:00010000:0.0:1787787367.792988:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787787367.792990:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d07059fda00, rc 0) 00000100:00100000:0.0:1787787367.793132:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+34:10506:x1874630678723072:12345-192.168.206.10@tcp:101:bash.0 Request processed in 2866us (3238us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1787787367.793141:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 96 00010000:00010000:3.0:1787787367.798825:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fca00/0xdeb1953cba4b1784 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787367.798842:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fca00/0xdeb1953cba4b1784 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787367.798850:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fca00/0xdeb1953cba4b1784 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787367.798856:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fca00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787367.798860:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fca00/0xdeb1953cba4b1784 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787367.798868:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fca00/0xdeb1953cba4b1784 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787367.798884:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d07096a0a00) 00010000:00010000:3.0:1787787367.798887:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787367.798893:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fca00/0xdeb1953cba4b1784 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787367.798900:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fca00/0xdeb1953cba4b1784 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787367.801944:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787367.802287:0:10776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678723200 00000100:00100000:0.0:1787787367.802297:0:10776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678723200 00000100:00100000:0.0:1787787367.802376:0:10776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 35 00000100:00100000:0.0:1787787367.802386:0:10776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2345:x1874630678723200:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:0.0:1787787367.802403:0:10776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787367.802422:0:10776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e4a61ff/0xdeb1953cba4b1799 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c351a5 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787787367.802514:0:10776:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787787367.802534:0:10776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=280s v=(0 0) 00010000:00010000:0.0:1787787367.802539:0:10776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787367.802558:0:10776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e4a61ff/0xdeb1953cba4b1799 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351a5 expref: 8 pid: 10776 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.802577:0:10776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005e4a61ff/0xdeb1953cba4b1799 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351a5 expref: 8 pid: 10776 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787367.802589:0:10776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d07059fd000, rc 0) 00000100:00080000:3.0:1787787367.802781:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787787367.803236:0:10776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+8:2345:x1874630678723200:12345-192.168.206.10@tcp:101:bash.0 Request processed in 849us (1296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787367.803245:0:10776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 35 00000100:00100000:1.0:1787787367.834823:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787367.835040:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678723328 00000100:00100000:3.0:1787787367.835049:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678723328 00000100:00100000:3.0:1787787367.835112:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 36 00000100:00100000:3.0:1787787367.835122:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07185a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+8:10506:x1874630678723328:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:3.0:1787787367.835147:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787367.835164:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001dbc658e/0xdeb1953cba4b17a0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c351ac expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787367.835194:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005e4a61ff/0xdeb1953cba4b1799 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351a5 expref: 9 pid: 10776 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787367.835204:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787367.835208:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787367.835213:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001dbc658e/0xdeb1953cba4b17a0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351ac expref: 9 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787367.835255:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005e4a61ff/0xdeb1953cba4b1799 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351a5 expref: 9 pid: 10776 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787367.835269:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005e4a61ff/0xdeb1953cba4b1799 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351a5 expref: 9 pid: 10776 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787367.835282:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fd783c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6673:1874630694468992:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787787367.835391:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d072daf5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787787367.838775:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787367.839994:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fd783c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6673:1874630694468992:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787787367.840028:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001dbc658e/0xdeb1953cba4b17a0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351ac expref: 9 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787367.840047:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708771800, rc 0) 00000100:00100000:3.0:1787787367.840112:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07185a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+9:10506:x1874630678723328:12345-192.168.206.10@tcp:101:bash.0 Request processed in 4992us (5298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787367.840122:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 36 00000100:00100000:1.0:1787787367.841760:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678723456 00000100:00100000:1.0:1787787367.841773:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678723456 00010000:00010000:1.0:1787787367.841820:0:8496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005e4a61ff/0xdeb1953cba4b1799 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351a5 expref: 9 pid: 10776 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787367.841859:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 49 00000100:00100000:1.0:1787787367.841868:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070873b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+9:2344:x1874630678723456:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787787367.841883:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787367.841903:0:8496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005e4a61ff/0xdeb1953cba4b1799 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351a5 expref: 9 pid: 10776 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.841929:0:8496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005e4a61ff/0xdeb1953cba4b1799 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351a5 expref: 9 pid: 10776 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.841952:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e4a61ff/0xdeb1953cba4b1799 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351a5 expref: 9 pid: 10776 timeout: 380 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.841968:0:8496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787367.841972:0:8496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787367.841981:0:8496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001dbc658e/0xdeb1953cba4b17a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351ac expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.841992:0:8496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001dbc658e/0xdeb1953cba4b17a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351ac expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787367.842026:0:8496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001dbc658e/0xdeb1953cba4b17a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351ac expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787367.842040:0:8496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0702fd43c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8496:1874630694469120:192.168.206.10@tcp:105: 00000100:00100000:1.0:1787787367.842116:0:8496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070860fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787787367.848333:0:8496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0702fd43c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8496:1874630694469120:192.168.206.10@tcp:105: 00010000:00010000:1.0:1787787367.848356:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787367.848414:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070873b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+8:2344:x1874630678723456:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 6545us (9644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787367.848426:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 49 00000100:00100000:2.0:1787787367.862907:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787367.862946:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678723712 00000100:00100000:2.0:1787787367.862961:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678723712 00000100:00100000:2.0:1787787367.863020:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 25 00000100:00100000:2.0:1787787367.863029:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+33:10506:x1874630678723712:12345-192.168.206.10@tcp:35:bash.0 00000100:00100000:2.0:1787787367.864091:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+34:10506:x1874630678723712:12345-192.168.206.10@tcp:35:bash.0 Request processed in 1059us (1189us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1787787367.864104:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 25 00000001:00080000:2.0:1787787367.880772:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:2.0:1787787367.880792:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:1.0:1787787368.063247:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787368.071698:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787368.072097:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678723840 00000100:00100000:2.0:1787787368.072106:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678723840 00000100:00100000:2.0:1787787368.072178:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 97 00000100:00100000:2.0:1787787368.072187:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+34:10522:x1874630678723840:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787787368.072211:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787368.072230:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b17a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c351b3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.072291:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b17ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.072305:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b17ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.072317:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b17ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787368.072372:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787787368.072376:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787787368.072398:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b17ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.072470:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b17a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351b3 expref: 36 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.072500:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b17ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351b3 expref: 35 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.072508:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d07078d0f00) 00010000:00010000:2.0:1787787368.072511:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787787368.072514:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd39200, rc 0) 00000100:00100000:2.0:1787787368.072576:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+35:10522:x1874630678723840:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 390us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787368.072583:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 97 00000100:00100000:2.0:1787787368.077813:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787368.077882:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678724096 00000100:00100000:1.0:1787787368.077892:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678724096 00000100:00100000:1.0:1787787368.077964:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 98 00000100:00100000:1.0:1787787368.077973:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+35:10522:x1874630678724096:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787787368.077993:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787368.078013:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d400/0xdeb1953cba4b17b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c351ba expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.078120:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1cc00/0xdeb1953cba4b17bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.078134:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1cc00/0xdeb1953cba4b17bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.078145:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1cc00/0xdeb1953cba4b17bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787368.078155:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787787368.078282:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d400/0xdeb1953cba4b17b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351ba expref: 38 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.078299:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1cc00/0xdeb1953cba4b17bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351ba expref: 37 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.078308:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07096a0100) 00010000:00010000:1.0:1787787368.078311:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787787368.078314:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1cc00, rc 0) 00000100:00100000:1.0:1787787368.078373:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+37:10522:x1874630678724096:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 401us (581us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1787787368.078399:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 98 00000100:00100000:3.0:1787787368.082674:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787368.082712:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787368.084020:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678724224 00000100:00100000:0.0:1787787368.084034:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678724224 00000100:00100000:0.0:1787787368.084116:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:0.0:1787787368.084128:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+37:2342:x1874630678724224:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787368.084145:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787368.084171:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1cc00/0xdeb1953cba4b17bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351ba expref: 37 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.084190:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07096a0100) 00010000:00010000:0.0:1787787368.084195:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787368.084749:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678724480 00000100:00100000:1.0:1787787368.084756:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678724480 00000100:00100000:1.0:1787787368.084792:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 99 00000100:00100000:1.0:1787787368.084800:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+37:10522:x1874630678724480:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787787368.084819:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787368.084834:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b17ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c351c1 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.084930:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c400/0xdeb1953cba4b17d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.084945:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c400/0xdeb1953cba4b17d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.084956:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c400/0xdeb1953cba4b17d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787368.084967:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787787368.085090:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b17ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351c1 expref: 40 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.085106:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c400/0xdeb1953cba4b17d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351c1 expref: 39 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.085114:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07096a0100) 00010000:00010000:1.0:1787787368.085117:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787787368.085119:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1c400, rc 0) 00000100:00100000:0.0:1787787368.085357:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+39:2342:x1874630678724224:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 1231us (2692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787368.085372:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:1.0:1787787368.087925:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+38:10522:x1874630678724480:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 3113us (5199us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1787787368.087938:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 99 00000100:00100000:3.0:1787787368.094609:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787368.094786:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678724608 00000100:00100000:1.0:1787787368.094797:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678724608 00000100:00100000:1.0:1787787368.094857:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 37 00000100:00100000:1.0:1787787368.094868:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073407f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2344:x1874630678724608:12345-192.168.206.10@tcp:1:lfs.0 00010000:00010000:1.0:1787787368.094918:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048021057/0xdeb1953cba4b17df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.094939:0:6674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001dbc658e/0xdeb1953cba4b17a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351ac expref: 6 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.094948:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787368.094953:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787787368.094958:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048021057/0xdeb1953cba4b17df lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.095003:0:6674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001dbc658e/0xdeb1953cba4b17a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351ac expref: 6 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.095018:0:6674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001dbc658e/0xdeb1953cba4b17a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351ac expref: 6 pid: 6673 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787368.095033:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0702fd43c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6674:1874630694469248:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787787368.095127:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070860f240 going to sleep for 11 seconds 00000100:00100000:1.0:1787787368.097319:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0702fd43c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6674:1874630694469248:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787787368.097343:0:6674:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048021057/0xdeb1953cba4b17df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787368.105988:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787368.107614:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678724736 00000100:00100000:2.0:1787787368.107626:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678724736 00002000:00100000:2.0:1787787368.107690:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9d073fd792c0 x1874630678724736/t0(0) o4->c5599457-aa74-4a71-951f-faabe33e6ec7@192.168.206.10@tcp:229/0 lens 504/0 e 0 to 0 dl 1787787379 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787787368.107701:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d073fd792c0 with x1874630678724736 ext(0->8) 00010000:00010000:2.0:1787787368.107710:0:6678:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001dbc658e/0xdeb1953cba4b17a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351ac expref: 7 pid: 6673 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.107728:0:6678:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001dbc658e/0xdeb1953cba4b17a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351ac expref: 7 pid: 6673 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787787368.107736:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d073fd792c0 00000100:00100000:2.0:1787787368.107771:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00100000:2.0:1787787368.107795:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2345:x1874630678724736:12345-192.168.206.10@tcp:4:lfs.0 00000100:00100000:2.0:1787787368.108316:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+9:2345:x1874630678724736:12345-192.168.206.10@tcp:4:lfs.0 Request processed in 521us (2336us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787787368.108325:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 1 00002000:00100000:2.0:1787787368.108332:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9d073fd792c0 x1874630678724736/t4294967302(0) o4->c5599457-aa74-4a71-951f-faabe33e6ec7@192.168.206.10@tcp:229/0 lens 504/448 e 0 to 0 dl 1787787379 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787787368.108341:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d073fd792c0 with x1874630678724736 ext(0->8) 00010000:00010000:2.0:1787787368.108348:0:6678:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001dbc658e/0xdeb1953cba4b17a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351ac expref: 9 pid: 6673 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.108362:0:6678:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001dbc658e/0xdeb1953cba4b17a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351ac expref: 9 pid: 6673 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787787368.108369:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d073fd792c0 00000100:00100000:3.0:1787787368.111852:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787368.112097:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678724864 00000100:00100000:0.0:1787787368.112106:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678724864 00010000:00010000:0.0:1787787368.112156:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001dbc658e/0xdeb1953cba4b17a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351ac expref: 9 pid: 6673 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787368.112196:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 50 00000100:00100000:0.0:1787787368.112206:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+9:2344:x1874630678724864:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787368.112222:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787787368.112239:0:5805:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787787368.112242:0:5805:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787787367 00002000:00010000:0.0:1787787368.112244:0:5805:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787787367 00002000:00010000:0.0:1787787368.112246:0:5805:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787787367 00010000:00010000:0.0:1787787368.112252:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001dbc658e/0xdeb1953cba4b17a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351ac expref: 9 pid: 6673 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.112265:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001dbc658e/0xdeb1953cba4b17a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351ac expref: 9 pid: 6673 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.112287:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001dbc658e/0xdeb1953cba4b17a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351ac expref: 9 pid: 6673 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.112303:0:5805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787787368.112308:0:5805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787787368.112314:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048021057/0xdeb1953cba4b17df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.112341:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048021057/0xdeb1953cba4b17df lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.112377:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787368.112429:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+8:2344:x1874630678724864:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 225us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787368.112740:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 50 00010000:00010000:2.0:1787787368.113768:0:6674:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048021057/0xdeb1953cba4b17df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.113783:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048021057/0xdeb1953cba4b17df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.113813:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048021057/0xdeb1953cba4b17df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.113822:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048021057/0xdeb1953cba4b17df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.113847:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048021057/0xdeb1953cba4b17df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.113853:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1ca00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:2.0:1787787368.113858:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048021057/0xdeb1953cba4b17df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.113867:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048021057/0xdeb1953cba4b17df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.113896:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048021057/0xdeb1953cba4b17df lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.113905:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048021057/0xdeb1953cba4b17df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787368.113989:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073407f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2344:x1874630678724608:12345-192.168.206.10@tcp:1:lfs.0 Request processed in 19120us (19387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787368.113999:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 37 00000100:00100000:3.0:1787787368.128275:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787368.128373:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678725120 00000100:00100000:0.0:1787787368.128382:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678725120 00000100:00100000:0.0:1787787368.128500:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 26 00000100:00100000:0.0:1787787368.128511:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703165850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+38:10522:x1874630678725120:12345-192.168.206.10@tcp:35:lfs.0 00000004:00010000:0.0:1787787368.128574:0:5822:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c400/0xdeb1953cba4b17d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351c1 expref: 38 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787787368.128820:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1787787368.128857:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1787787368.129142:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1787787368.129194:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b17e6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.129208:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fda00/0xdeb1953cba4b178b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3519e expref: 42 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.129218:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b17e6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.129249:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fda00/0xdeb1953cba4b178b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3519e expref: 42 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.129271:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fda00/0xdeb1953cba4b178b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3519e expref: 42 pid: 9687 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787368.129286:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06020ebc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5822:1874630694469376:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787787368.129376:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073d9bc540 going to sleep for 11 seconds 00000100:00100000:3.0:1787787368.141319:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06020ebc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5822:1874630694469376:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787787368.141349:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b17e6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787368.144029:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787368.144252:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678725248 00000100:00100000:2.0:1787787368.144261:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678725248 00010000:00010000:2.0:1787787368.144302:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fda00/0xdeb1953cba4b178b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3519e expref: 43 pid: 9687 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787368.144344:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 51 00000100:00100000:2.0:1787787368.144368:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+43:2344:x1874630678725248:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787368.144384:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787368.144390:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fda00/0xdeb1953cba4b178b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3519e expref: 43 pid: 9687 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.144403:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fda00/0xdeb1953cba4b178b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3519e expref: 43 pid: 9687 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.144424:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fda00/0xdeb1953cba4b178b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3519e expref: 43 pid: 9687 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.144499:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07096a0100) 00010000:00010000:2.0:1787787368.144504:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b17e6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.144513:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b17e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.144520:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b17e6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.144547:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787368.144594:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+42:2344:x1874630678725248:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 227us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787368.144602:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 51 00010000:00010000:1.0:1787787368.144683:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b17e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.144692:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b17e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787787368.144811:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1787787368.145001:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1787787368.145104:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0702fd43c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5822:1874630694469504:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787787368.145220:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787368.145252:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070860fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787787368.145367:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694469504 00000100:00100000:2.0:1787787368.145373:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694469504 00000100:00100000:2.0:1787787368.145421:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787787368.145428:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5822:x1874630694469504:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787787368.145540:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5822:x1874630694469504:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 112us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787368.145547:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787787368.146230:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787787368.146266:0:5822:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1787787368.146272:0:5822:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1787787368.146290:0:5822:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d0707a08b40, transno 4294967301 00000100:00100000:1.0:1787787368.146313:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0702fd43c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5822:1874630694469504:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787787368.146781:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1787787368.146846:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0702fd43c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5822:1874630694469632:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787787368.146919:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787368.146944:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070860f240 going to sleep for 11 seconds 00000100:00100000:2.0:1787787368.147096:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694469632 00000100:00100000:2.0:1787787368.147102:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694469632 00000100:00100000:2.0:1787787368.147839:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787787368.147852:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5822:x1874630694469632:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787787368.148041:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5822:x1874630694469632:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 193us (1122us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787787368.148049:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787787368.148431:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0702fd43c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5822:1874630694469632:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787787368.148530:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1787787368.148576:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b17e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.148587:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b17e6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.148595:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b17e6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.148600:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fc000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787368.148604:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b17e6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.148612:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b17e6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.148627:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07096a0100) 00010000:00010000:0.0:1787787368.148630:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787787368.148634:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b17e6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.148657:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b17e6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787787368.148824:0:5822:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787787368.148892:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1787787368.148915:0:5822:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 280375476012ns, next at 281375474053ns, rc = 0 00000001:00080000:0.0:1787787368.148921:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1787787368.148949:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07096a0100) 00010000:00010000:0.0:1787787368.148952:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787787368.148958:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c400/0xdeb1953cba4b17d1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351c1 expref: 46 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787368.149055:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703165850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+45:10522:x1874630678725120:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 20546us (20789us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1787787368.149064:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 26 00000020:00080000:0.0:1787787368.149068:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787787368.160040:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787368.160156:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678725376 00000100:00100000:1.0:1787787368.160165:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678725376 00000100:00100000:1.0:1787787368.160233:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 100 00000100:00100000:1.0:1787787368.160244:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+45:10522:x1874630678725376:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787787368.160283:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787368.160309:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b17ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c351c8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.160368:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b17ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351c8 expref: 46 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.160383:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b17ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351c8 expref: 46 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.160404:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07114acf00) 00010000:00010000:1.0:1787787368.160407:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787787368.160410:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1c600, rc 0) 00000100:00100000:1.0:1787787368.160520:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+46:10522:x1874630678725376:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 278us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787368.160528:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 100 00000100:00100000:3.0:1787787368.164420:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787368.164639:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678725632 00000100:00100000:2.0:1787787368.164649:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678725632 00000100:00100000:2.0:1787787368.164705:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 27 00000100:00100000:2.0:1787787368.164714:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+46:10522:x1874630678725632:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:2.0:1787787368.164948:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+47:10522:x1874630678725632:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 234us (536us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1787787368.164956:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 27 00000100:00100000:3.0:1787787368.277090:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787368.277366:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678725760 00000100:00100000:2.0:1787787368.277377:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678725760 00000100:00100000:2.0:1787787368.277482:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 101 00000100:00100000:2.0:1787787368.277507:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+47:10532:x1874630678725760:12345-192.168.206.10@tcp:34:lfs.0 00010000:00010000:2.0:1787787368.277579:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b17f4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.277597:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b17f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.277625:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b17f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.277641:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b17fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.277649:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b17fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.277655:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b17fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.277753:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1802 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.277761:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.277768:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787787368.278040:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.278053:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b17f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.278059:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b17f4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.278066:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b17f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.278084:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd38600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787368.278088:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b17f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.278096:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b17f4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.278109:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d07078d0f00) 00010000:00010000:2.0:1787787368.278112:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787368.278116:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b17f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.278122:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b17f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.278134:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b17fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.278206:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b17fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.278213:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b17fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.278345:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd38000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787368.278349:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b17fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.278356:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b17fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.278374:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d07078d0b00) 00010000:00010000:2.0:1787787368.278376:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787368.278379:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b17fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.278385:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b17fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.278400:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.278406:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1802 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.278412:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1802 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.278416:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd38a00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787368.278419:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1802 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.278424:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1802 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.278431:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07114acf00) 00010000:00010000:2.0:1787787368.278433:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787368.278541:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1802 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.278549:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1802 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787368.278756:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+47:10532:x1874630678725760:12345-192.168.206.10@tcp:34:lfs.0 Request processed in 1247us (1672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787368.278765:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 101 00000100:00100000:3.0:1787787368.336368:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787368.336557:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678726016 00000100:00100000:1.0:1787787368.336567:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678726016 00000100:00100000:1.0:1787787368.336624:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 102 00000100:00100000:1.0:1787787368.336633:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+47:10535:x1874630678726016:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787787368.336653:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787368.336671:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d400/0xdeb1953cba4b1809 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c351cf expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.336738:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1810 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.336752:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1810 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.336775:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1810 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.336792:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d000/0xdeb1953cba4b1817 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.336799:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d000/0xdeb1953cba4b1817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.336806:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d000/0xdeb1953cba4b1817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.336945:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b181e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.336954:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b181e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.336962:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b181e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787368.336971:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787787368.337057:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1810 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.337064:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1810 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.337071:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1810 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.337076:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1da00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787368.337085:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1810 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.337093:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1810 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.337105:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d07078d0f00) 00010000:00010000:1.0:1787787368.337108:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787368.337113:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1810 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.337119:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1810 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.337145:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d000/0xdeb1953cba4b1817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.337151:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d000/0xdeb1953cba4b1817 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.337157:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d000/0xdeb1953cba4b1817 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.337162:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1d000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787368.337165:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d000/0xdeb1953cba4b1817 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.337170:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d000/0xdeb1953cba4b1817 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.337176:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d07114ac400) 00010000:00010000:1.0:1787787368.337178:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787368.337187:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d000/0xdeb1953cba4b1817 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.337193:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d000/0xdeb1953cba4b1817 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.337231:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d400/0xdeb1953cba4b1809 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351cf expref: 50 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.337245:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b181e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351cf expref: 49 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.337252:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07114acf00) 00010000:00010000:1.0:1787787368.337254:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787787368.337256:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1c200, rc 0) 00000100:00100000:1.0:1787787368.337322:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+49:10535:x1874630678726016:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 690us (963us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1787787368.337329:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 102 00000100:00100000:0.0:1787787368.341684:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787368.341774:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678726144 00000100:00100000:1.0:1787787368.341783:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678726144 00000100:00100000:1.0:1787787368.341849:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 103 00000100:00100000:1.0:1787787368.341858:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06020ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+49:10535:x1874630678726144:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:1.0:1787787368.341925:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c000/0xdeb1953cba4b182c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.341939:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c000/0xdeb1953cba4b182c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.341949:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c000/0xdeb1953cba4b182c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.341990:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c000/0xdeb1953cba4b182c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.341996:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c000/0xdeb1953cba4b182c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.342003:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c000/0xdeb1953cba4b182c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.342009:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1c000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787368.342014:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c000/0xdeb1953cba4b182c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.342021:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c000/0xdeb1953cba4b182c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.342033:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07114acf00) 00010000:00010000:1.0:1787787368.342036:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787787368.342040:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c000/0xdeb1953cba4b182c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.342046:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c000/0xdeb1953cba4b182c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787368.342116:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06020ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+49:10535:x1874630678726144:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 259us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787368.342123:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 103 00000100:00100000:3.0:1787787368.345866:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787368.346050:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678726400 00000100:00100000:2.0:1787787368.346060:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678726400 00000100:00100000:2.0:1787787368.346121:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 28 00000100:00100000:2.0:1787787368.346132:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+49:10535:x1874630678726400:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:2.0:1787787368.346365:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+50:10535:x1874630678726400:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 234us (508us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1787787368.346373:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 28 00000100:00100000:0.0:1787787368.420337:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787368.420380:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787368.420416:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787368.420479:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787368.420565:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678726528 00000100:00100000:1.0:1787787368.420573:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678726528 00000100:00100000:1.0:1787787368.420630:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 281 00000100:00100000:1.0:1787787368.420653:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2343:x1874630678726528:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787787368.420721:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2343:x1874630678726528:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 69us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787368.420728:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 281 00000100:00100000:1.0:1787787368.420760:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678726912 00000100:00100000:1.0:1787787368.420763:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678726912 00000100:00100000:1.0:1787787368.420800:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 125 00000100:00100000:1.0:1787787368.420806:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06020ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2343:x1874630678726912:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787787368.420835:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06020ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2343:x1874630678726912:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 29us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787368.420841:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 125 00000100:00080000:1.0:1787787368.420856:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787368.421019:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678726784 00000100:00100000:2.0:1787787368.421024:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678726784 00000100:00100000:2.0:1787787368.421057:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678726656 00000100:00100000:2.0:1787787368.421060:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678726656 00000100:00100000:2.0:1787787368.421083:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 69 00000100:00100000:2.0:1787787368.421089:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06020ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2343:x1874630678726784:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787787368.421114:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06020ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2343:x1874630678726784:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 26us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787368.421120:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 69 00000100:00100000:2.0:1787787368.421141:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 70 00000100:00100000:2.0:1787787368.421148:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06020ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2343:x1874630678726656:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787787368.421170:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06020ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2343:x1874630678726656:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 23us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787368.421176:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 70 00000100:00100000:3.0:1787787368.442358:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787368.442512:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678727168 00000100:00100000:1.0:1787787368.442521:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678727168 00000100:00100000:1.0:1787787368.442575:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 104 00000100:00100000:1.0:1787787368.442585:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+50:10545:x1874630678727168:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:1.0:1787787368.442606:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787368.442609:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787787368.442634:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b17ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351b3 expref: 50 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.442654:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d07078d0f00) 00010000:00010000:1.0:1787787368.442659:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787787368.442670:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c000/0xdeb1953cba4b1833 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c351d6 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.442770:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d400/0xdeb1953cba4b183a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.442783:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b181e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351cf expref: 50 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.442790:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d400/0xdeb1953cba4b183a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.442831:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b181e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351cf expref: 50 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.442844:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b181e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351cf expref: 50 pid: 5821 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787368.442855:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0702fd7840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5819:1874630694469760:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787787368.442950:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070860f240 going to sleep for 11 seconds 00000100:00100000:3.0:1787787368.446121:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787368.446265:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678727296 00000100:00100000:0.0:1787787368.446273:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678727296 00010000:00010000:0.0:1787787368.446309:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b181e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351cf expref: 51 pid: 5821 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787368.446354:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 52 00000100:00100000:0.0:1787787368.446364:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd77840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+51:2344:x1874630678727296:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787368.446384:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787368.446392:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b181e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351cf expref: 51 pid: 5821 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.446405:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b181e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351cf expref: 51 pid: 5821 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.446426:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07114acf00) 00010000:00010000:0.0:1787787368.446432:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d400/0xdeb1953cba4b183a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.446473:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d400/0xdeb1953cba4b183a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.446481:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d400/0xdeb1953cba4b183a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.446510:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787368.446571:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd77840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+51:2344:x1874630678727296:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 208us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787368.446579:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 52 00010000:00010000:1.0:1787787368.448778:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b181e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351cf expref: 50 pid: 5821 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787368.448813:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0702fd7840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5819:1874630694469760:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787787368.448834:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d400/0xdeb1953cba4b183a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.448843:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d400/0xdeb1953cba4b183a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.448864:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d400/0xdeb1953cba4b183a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787368.448974:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787787368.449106:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c000/0xdeb1953cba4b1833 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351d6 expref: 51 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.449119:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d400/0xdeb1953cba4b183a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351d6 expref: 50 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.449187:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07114acf00) 00010000:00010000:1.0:1787787368.449191:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787787368.449195:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1d400, rc 0) 00000100:00100000:1.0:1787787368.449304:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+50:10545:x1874630678727168:12345-192.168.206.10@tcp:101:bash.0 Request processed in 6719us (6953us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1787787368.449312:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 104 00000100:00100000:0.0:1787787368.452640:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787368.452729:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678727552 00000100:00100000:1.0:1787787368.452740:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678727552 00000100:00100000:1.0:1787787368.453004:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 105 00000100:00100000:1.0:1787787368.453015:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06020eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+50:10545:x1874630678727552:12345-192.168.206.10@tcp:36:bash.0 00010000:00010000:1.0:1787787368.453280:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d000/0xdeb1953cba4b1848 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.453297:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d000/0xdeb1953cba4b1848 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.453309:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d000/0xdeb1953cba4b1848 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787787368.453375:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1787787368.453400:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d6b3fb7 reply state 000000006c276ccc transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d000/0xdeb1953cba4b1848 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787368.453408:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787787368.453681:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06020eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+53:10545:x1874630678727552:12345-192.168.206.10@tcp:36:bash.0 Request processed in 666us (1049us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1787787368.453689:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 105 00000020:00080000:1.0:1787787368.453696:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787787368.458220:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787368.458391:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678727680 00000100:00100000:1.0:1787787368.458400:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678727680 00000100:00100000:1.0:1787787368.458457:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 106 00000100:00100000:1.0:1787787368.458466:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+53:10545:x1874630678727680:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:1.0:1787787368.458497:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787368.458515:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c000/0xdeb1953cba4b184f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c351dd expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.458590:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b1856 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.458604:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d400/0xdeb1953cba4b183a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351d6 expref: 54 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.458612:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d000/0xdeb1953cba4b1848 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.458618:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b1856 lrc: 5/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.458651:0:5821:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d000/0xdeb1953cba4b1848 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.458673:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d400/0xdeb1953cba4b183a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351d6 expref: 54 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.458686:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d400/0xdeb1953cba4b183a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351d6 expref: 54 pid: 5819 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787368.458698:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0702fd7840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5821:1874630694469888:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787787368.459237:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d000/0xdeb1953cba4b1848 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.459247:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d000/0xdeb1953cba4b1848 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.459253:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d000/0xdeb1953cba4b1848 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.459259:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1d000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787368.459262:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d000/0xdeb1953cba4b1848 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.459269:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d000/0xdeb1953cba4b1848 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.459283:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07114acf00) 00010000:00010000:2.0:1787787368.459286:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787368.459289:0:3277:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b1856 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.459297:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d000/0xdeb1953cba4b1848 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.459303:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d000/0xdeb1953cba4b1848 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787368.459654:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07086136c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787368.466326:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787368.466385:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678727808 00000100:00100000:3.0:1787787368.466393:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678727808 00010000:00010000:3.0:1787787368.466428:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d400/0xdeb1953cba4b183a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351d6 expref: 54 pid: 5819 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787368.466481:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 53 00000100:00100000:3.0:1787787368.466499:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd76940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+54:2345:x1874630678727808:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787368.466514:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787368.466521:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d400/0xdeb1953cba4b183a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351d6 expref: 54 pid: 5819 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787368.466536:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d400/0xdeb1953cba4b183a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351d6 expref: 54 pid: 5819 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787368.466556:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07114acf00) 00010000:00010000:3.0:1787787368.466561:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b1856 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787368.466570:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b1856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787368.466578:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b1856 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787368.466595:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787368.466647:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd76940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+54:2345:x1874630678727808:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 149us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787368.466654:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 53 00010000:00010000:1.0:1787787368.467142:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d400/0xdeb1953cba4b183a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351d6 expref: 53 pid: 5819 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787368.467160:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0702fd7840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5821:1874630694469888:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787787368.467177:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b1856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.467186:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b1856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.467192:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b1856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787368.467230:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787787368.467233:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787787368.467250:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b1856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.467290:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c000/0xdeb1953cba4b184f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351dd expref: 53 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.467304:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b1856 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351dd expref: 52 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.467311:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07114acf00) 00010000:00010000:1.0:1787787368.467314:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787787368.467317:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1c200, rc 0) 00000100:00100000:1.0:1787787368.467345:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+52:10545:x1874630678727680:12345-192.168.206.10@tcp:101:bash.0 Request processed in 8881us (9134us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787368.467353:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 106 00000100:00100000:0.0:1787787368.471791:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787368.472255:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678728064 00000100:00100000:2.0:1787787368.472265:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678728064 00000100:00100000:2.0:1787787368.472327:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 29 00000100:00100000:2.0:1787787368.472337:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06020e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+52:10545:x1874630678728064:12345-192.168.206.10@tcp:35:bash.0 00000100:00100000:2.0:1787787368.473078:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06020e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+53:10545:x1874630678728064:12345-192.168.206.10@tcp:35:bash.0 Request processed in 739us (1292us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1787787368.473099:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 29 00000100:00100000:2.0:1787787368.527637:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787368.534617:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678728192 00000100:00100000:0.0:1787787368.534633:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678728192 00000100:00100000:0.0:1787787368.534718:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 107 00000100:00100000:0.0:1787787368.534729:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+53:10551:x1874630678728192:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787787368.534752:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787368.534787:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b185d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c351e4 expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.534976:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1864 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.535002:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.535015:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787368.535070:0:9687:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787787368.535074:0:9687:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787787368.535096:0:9687:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.535121:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b185d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351e4 expref: 55 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.535138:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1864 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351e4 expref: 54 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.535146:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d07078d0f00) 00010000:00010000:0.0:1787787368.535149:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787787368.535152:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d07059fd400, rc 0) 00000100:00100000:0.0:1787787368.535220:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+54:10551:x1874630678728192:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 493us (7592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787368.535228:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 107 00000100:00100000:3.0:1787787368.539754:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787368.540189:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678728320 00000100:00100000:2.0:1787787368.540200:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678728320 00000100:00100000:2.0:1787787368.540249:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 108 00000100:00100000:2.0:1787787368.540259:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+54:10551:x1874630678728320:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787787368.540280:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787368.540300:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b186b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c351eb expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.540361:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1872 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.540376:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1872 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.540387:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1872 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.540401:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1879 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.540410:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.540417:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.540543:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b1880 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.540565:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b1880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.540573:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b1880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787368.540608:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787787368.540613:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787787368.540631:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b1880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.540643:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b1880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.540652:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1872 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.540659:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1872 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.540665:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1872 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.540672:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd38600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787368.540676:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1872 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.540683:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1872 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.540695:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d07078d0f00) 00010000:00010000:2.0:1787787368.540698:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787368.540709:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1872 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.540717:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1872 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.540731:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.540738:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1879 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.540743:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1879 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.540749:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787368.540752:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1879 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.540759:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1879 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.540768:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d07078d0b00) 00010000:00010000:2.0:1787787368.540770:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787368.540773:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1879 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.540779:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1879 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.540808:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b186b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351eb expref: 56 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.540837:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b1880 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351eb expref: 55 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.540845:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07114acf00) 00010000:00010000:2.0:1787787368.540847:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787787368.540849:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd38c00, rc 0) 00000100:00100000:2.0:1787787368.540915:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+55:10551:x1874630678728320:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 657us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787368.540922:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 108 00000100:00100000:3.0:1787787368.545533:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787368.545755:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678728448 00000100:00100000:0.0:1787787368.545776:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678728448 00000100:00100000:0.0:1787787368.545835:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:0.0:1787787368.545845:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd74b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+55:2343:x1874630678728448:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787368.545860:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787368.545884:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b1880 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351eb expref: 55 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.545902:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07114acf00) 00010000:00010000:0.0:1787787368.545907:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787368.545963:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd74b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+54:2343:x1874630678728448:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 119us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787368.545970:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:3.0:1787787368.546515:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787368.547770:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678728704 00000100:00100000:0.0:1787787368.547781:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678728704 00000100:00100000:0.0:1787787368.547887:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 109 00000100:00100000:0.0:1787787368.547897:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+54:10551:x1874630678728704:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787787368.547915:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787368.547932:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1887 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c351f2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.548204:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b188e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.548219:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b1856 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351dd expref: 55 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.548228:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b188e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.548271:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b1856 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351dd expref: 55 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.548283:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b1856 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351dd expref: 55 pid: 5821 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787368.548296:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06020eb0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1874630694470016:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787787368.548388:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073d9bc300 going to sleep for 11 seconds 00000100:00100000:0.0:1787787368.554160:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06020eb0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1874630694470016:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787787368.554192:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b188e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787368.555704:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787368.556468:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678728832 00000100:00100000:2.0:1787787368.556493:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678728832 00010000:00010000:2.0:1787787368.556535:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b1856 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351dd expref: 56 pid: 5821 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787368.556574:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 54 00000100:00100000:2.0:1787787368.556584:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0708738050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+56:2345:x1874630678728832:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787368.556599:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787368.556606:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b1856 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351dd expref: 56 pid: 5821 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.556618:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b1856 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351dd expref: 56 pid: 5821 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.556636:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b1856 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351dd expref: 56 pid: 5821 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.557189:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07114acf00) 00010000:00010000:2.0:1787787368.557194:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b188e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.557202:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b188e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.557210:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b188e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787368.557275:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787368.557339:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0708738050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+55:2345:x1874630678728832:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 755us (1641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787368.557347:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 54 00010000:00010000:0.0:1787787368.557936:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b188e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.557948:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b188e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787368.557971:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787787368.558132:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1887 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351f2 expref: 56 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.558147:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b188e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351f2 expref: 55 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.558155:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07114acf00) 00010000:00010000:0.0:1787787368.558157:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787787368.558167:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d07059fcc00, rc 0) 00000100:00100000:0.0:1787787368.558280:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+55:10551:x1874630678728704:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 10383us (11764us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1787787368.558289:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 109 00000100:00100000:3.0:1787787368.567898:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787368.567987:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678729088 00000100:00100000:0.0:1787787368.567997:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678729088 00000100:00100000:0.0:1787787368.568118:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:0.0:1787787368.568130:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd743c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+55:10551:x1874630678729088:12345-192.168.206.10@tcp:103:lfs.0 00010000:00010000:0.0:1787787368.568147:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787368.568170:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b17ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351c8 expref: 55 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787368.568188:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07114acf00) 00010000:00010000:0.0:1787787368.568193:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787368.568267:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd743c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+54:10551:x1874630678729088:12345-192.168.206.10@tcp:103:lfs.0 Request processed in 139us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787368.568274:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:3.0:1787787368.575539:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787368.579267:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678729216 00000100:00100000:1.0:1787787368.579282:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678729216 00000100:00100000:1.0:1787787368.579422:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 110 00000100:00100000:1.0:1787787368.579436:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+54:10551:x1874630678729216:12345-192.168.206.10@tcp:58:lfs.0 00010000:00010000:1.0:1787787368.579566:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c000/0xdeb1953cba4b189c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.579582:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c000/0xdeb1953cba4b189c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.579594:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c000/0xdeb1953cba4b189c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787787368.579788:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1787787368.579881:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+54:10551:x1874630678729216:12345-192.168.206.10@tcp:58:lfs.0 Request processed in 448us (4351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787368.579905:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 110 00000100:00100000:3.0:1787787368.584005:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787368.584268:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678729344 00000100:00100000:1.0:1787787368.584278:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678729344 00000100:00100000:1.0:1787787368.584336:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 111 00000100:00100000:1.0:1787787368.584346:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+54:10551:x1874630678729344:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787787368.584365:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787368.584383:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d400/0xdeb1953cba4b18a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c351f9 expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.584463:0:9687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c000/0xdeb1953cba4b189c lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.584475:0:9687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d400/0xdeb1953cba4b18a3 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351f9 expref: 55 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.584757:0:9687:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c000/0xdeb1953cba4b189c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.584772:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d400/0xdeb1953cba4b18a3 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351f9 expref: 55 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.584785:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07114acf00) 00010000:00010000:1.0:1787787368.584788:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787787368.584792:0:9687:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d400/0xdeb1953cba4b18a3 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351f9 expref: 55 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787368.584800:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1d400, rc 0) 00000100:00100000:1.0:1787787368.584872:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+55:10551:x1874630678729344:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 527us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787368.584880:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 111 00010000:00010000:2.0:1787787369.085640:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787787369.468827:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787787369.468837:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787787369.468884:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1787787369.468891:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787787369.469005:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0702fd7840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874630694470144:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787787369.469128:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0708613780 going to sleep for 11 seconds 00000100:00100000:3.0:1787787369.490424:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787369.491019:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678729472 00000100:00100000:2.0:1787787369.491029:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678729472 00000100:00100000:2.0:1787787369.491112:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 112 00000100:00100000:2.0:1787787369.491133:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+56:10552:x1874630678729472:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787787369.491163:0:5819:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787787369.491259:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+56:10552:x1874630678729472:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 138us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787369.491267:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 112 00000100:00100000:1.0:1787787369.491624:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0702fd7840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874630694470144:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00080000:3.0:1787787369.491844:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787369.509189:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787369.509884:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678729600 00000100:00100000:0.0:1787787369.509895:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678729600 00000100:00100000:0.0:1787787369.509956:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 113 00000100:00100000:0.0:1787787369.509967:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+55:10552:x1874630678729600:12345-192.168.206.10@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787787369.510034:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b18aa lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.510051:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b18aa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.510061:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b18aa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.510140:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b18b1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.510149:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b18b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.510157:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b18b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.510179:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b18b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.510187:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b18b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.510193:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b18b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787369.510227:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787787369.510231:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787787369.510245:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b18b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.510254:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b18aa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.510260:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b18aa lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.510266:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b18aa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.510282:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fdc00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787369.510286:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b18aa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.510293:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b18aa lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.510305:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d071b71da00) 00010000:00010000:0.0:1787787369.510308:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787369.510312:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b18aa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.510319:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b18aa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.510332:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b18b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.510337:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b18b1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.510343:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b18b1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.510347:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fc400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787369.510350:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b18b1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.510355:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b18b1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.510373:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9d07096a0100) 00010000:00010000:0.0:1787787369.510376:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787369.510379:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b18b1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.510383:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b18b1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.510402:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b18b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.510409:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b18b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.510415:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b18b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.510420:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fc600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787369.510422:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b18b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.510427:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b18b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.510434:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07114acf00) 00010000:00010000:0.0:1787787369.512743:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787369.512765:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b18b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.512776:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b18b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787369.512915:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+55:10552:x1874630678729600:12345-192.168.206.10@tcp:34:lhsmtool_posix.0 Request processed in 2946us (3730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787369.512924:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 113 00000100:00100000:2.0:1787787369.520534:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787369.520772:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678729856 00000100:00100000:1.0:1787787369.520782:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678729856 00000100:00100000:1.0:1787787369.520841:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 114 00000100:00100000:1.0:1787787369.520851:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+55:10552:x1874630678729856:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787787369.520883:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787369.520905:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b18bf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35200 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.521096:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b18c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.521111:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b18c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.521134:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b18c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787369.521146:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787787369.521255:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b18c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.521263:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b18c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.521268:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b18c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.521274:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1ce00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787369.521278:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b18c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.521286:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b18c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.521297:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07114acf00) 00010000:00010000:1.0:1787787369.521300:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787787369.521304:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b18c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.521310:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b18c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.521349:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b18bf lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35200 expref: 57 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.521360:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d071b71da00) 00010000:00010000:1.0:1787787369.521362:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787787369.521366:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b18bf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35200 expref: 57 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.521387:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1da00, rc 0) 00000100:00100000:1.0:1787787369.521506:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+56:10552:x1874630678729856:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 656us (979us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1787787369.521514:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 114 00000100:00100000:3.0:1787787369.524603:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787369.525010:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678729984 00000100:00100000:1.0:1787787369.525019:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678729984 00000100:00100000:1.0:1787787369.525076:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 115 00000100:00100000:1.0:1787787369.525087:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+56:10552:x1874630678729984:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787787369.525120:0:9687:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787787369.525456:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+56:10552:x1874630678729984:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 349us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787369.525466:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 115 00000100:00100000:2.0:1787787369.537494:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787369.537606:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678730240 00000100:00100000:1.0:1787787369.537615:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678730240 00000100:00100000:1.0:1787787369.537668:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 116 00000100:00100000:1.0:1787787369.537678:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+56:10552:x1874630678730240:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787787369.537700:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787369.537703:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787787369.537732:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1864 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351e4 expref: 56 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.537751:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d07078d0f00) 00010000:00010000:1.0:1787787369.537756:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787787369.537770:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b18d4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35207 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787787369.538228:0:5819:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1787787369.538429:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b18db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.538508:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b18db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.538518:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b18db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.538575:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b18d4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35207 expref: 58 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.538590:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b18db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35207 expref: 57 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.538598:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d07114ac400) 00010000:00010000:1.0:1787787369.538601:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787787369.538603:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1ce00, rc 0) 00000100:00100000:1.0:1787787369.538664:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+57:10552:x1874630678730240:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 987us (1238us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1787787369.538673:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 116 00000100:00100000:2.0:1787787369.549135:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787369.549223:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678730496 00000100:00100000:0.0:1787787369.549232:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678730496 00000100:00100000:0.0:1787787369.549288:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 117 00000100:00100000:0.0:1787787369.549297:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+57:10552:x1874630678730496:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787787369.549349:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787369.549376:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b18db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35207 expref: 57 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.549394:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d07114ac400) 00010000:00010000:0.0:1787787369.549403:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787787369.549423:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b18e9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.549503:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b18e9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.549515:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b18e9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.549552:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b18f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xee2dcc22 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.549561:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b18f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xee2dcc22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.549567:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b18f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xee2dcc22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.549650:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b18e9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.549657:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b18e9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.549664:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b18e9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.549671:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fc600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787369.549674:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b18e9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.549681:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b18e9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.549690:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d07078d0f00) 00010000:00010000:0.0:1787787369.549693:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787369.549697:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b18e9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.549702:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b18e9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.549718:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b18f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xee2dcc22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.549724:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b18f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xee2dcc22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.549730:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b18f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xee2dcc22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.549743:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fc400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787369.549746:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b18f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xee2dcc22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.549752:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b18f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xee2dcc22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.549761:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xee2dcc22 (ffff9d07096a0100) 00010000:00010000:0.0:1787787369.549763:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787369.549766:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b18f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xee2dcc22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.549772:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b18f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xee2dcc22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787369.549841:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+56:10552:x1874630678730496:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 545us (724us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787787369.549848:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 117 00000100:00100000:2.0:1787787369.553768:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787369.553875:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678730624 00000100:00100000:1.0:1787787369.553884:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678730624 00000100:00100000:1.0:1787787369.553953:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 118 00000100:00100000:1.0:1787787369.553963:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+56:10552:x1874630678730624:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787787369.553984:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787369.554012:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b18f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3520e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.554049:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b18fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.554062:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b18fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.554072:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b18fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.554178:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b18f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3520e expref: 58 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.554195:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b18fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3520e expref: 57 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.554204:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d07114aca00) 00010000:00010000:1.0:1787787369.554207:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787787369.554210:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1dc00, rc 0) 00000100:00100000:1.0:1787787369.554276:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+57:10552:x1874630678730624:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 314us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787369.554283:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 118 00000100:00100000:2.0:1787787369.558205:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787369.558280:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678730880 00000100:00100000:0.0:1787787369.558290:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678730880 00000100:00100000:0.0:1787787369.558347:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 119 00000100:00100000:0.0:1787787369.558358:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+57:10552:x1874630678730880:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787787369.558432:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1905 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.558509:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1905 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.558521:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1905 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787787369.558769:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1787787369.558779:0:5820:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 281785339893ns, next at 282785337711ns, rc = 0 00000004:00010000:0.0:1787787369.558860:0:5820:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c333835 reply state 00000000a9d9b9ab transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1905 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787369.558869:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787787369.558954:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+59:10552:x1874630678730880:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 597us (756us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1787787369.558962:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 119 00010000:00010000:3.0:1787787369.560677:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1905 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.560694:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1905 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.560701:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1905 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.560707:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fdc00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787369.560712:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1905 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.560720:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1905 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.560736:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d07114aca00) 00010000:00010000:3.0:1787787369.560752:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787787369.560758:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1905 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.560765:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1905 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787369.562250:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787369.562326:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678731008 00000100:00100000:1.0:1787787369.562335:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678731008 00000100:00100000:1.0:1787787369.562392:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 120 00000100:00100000:1.0:1787787369.562401:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+58:10552:x1874630678731008:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787787369.562424:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787369.562507:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b190c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35215 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.562565:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b190c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35215 expref: 59 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.562580:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b190c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35215 expref: 59 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.562598:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d07114aca00) 00010000:00010000:1.0:1787787369.562601:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787787369.562604:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1da00, rc 0) 00000100:00100000:1.0:1787787369.562653:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+59:10552:x1874630678731008:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 253us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787369.562661:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 120 00000100:00100000:2.0:1787787369.565813:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787369.565912:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678731136 00000100:00100000:1.0:1787787369.565922:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678731136 00000100:00100000:1.0:1787787369.565988:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 38 00000100:00100000:1.0:1787787369.565999:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2342:x1874630678731136:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787787369.566331:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2342:x1874630678731136:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 Request processed in 333us (524us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787787369.566341:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 38 00000100:00080000:3.0:1787787369.566503:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787369.568773:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787369.568877:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678731392 00000100:00100000:0.0:1787787369.568887:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678731392 00000100:00100000:0.0:1787787369.568948:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 30 00000100:00100000:0.0:1787787369.568958:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+59:10552:x1874630678731392:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787787369.569309:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+60:10552:x1874630678731392:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 350us (541us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1787787369.569317:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 30 00000100:00100000:3.0:1787787369.573356:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787369.573508:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678731648 00000100:00100000:0.0:1787787369.573518:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678731648 00000100:00100000:0.0:1787787369.573576:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 121 00000100:00100000:0.0:1787787369.573586:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+60:10552:x1874630678731648:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787787369.573700:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+60:10552:x1874630678731648:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 116us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787369.573708:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 121 00000100:00100000:3.0:1787787369.577427:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787369.577564:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678731776 00000100:00100000:0.0:1787787369.577574:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678731776 00000100:00100000:0.0:1787787369.577645:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 122 00000100:00100000:0.0:1787787369.577655:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+60:10552:x1874630678731776:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787787369.577675:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787369.577694:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1913 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3521c expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.577759:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b191a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.577773:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b191a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.577785:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b191a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787369.577820:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787787369.577838:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b191a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.577863:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1913 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3521c expref: 62 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.577900:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b191a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3521c expref: 61 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.578053:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d07114aca00) 00010000:00010000:0.0:1787787369.578057:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787787369.578060:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d07059fc600, rc 0) 00000100:00100000:0.0:1787787369.578111:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+61:10552:x1874630678731776:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 458us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787369.578141:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 122 00000100:00100000:2.0:1787787369.585433:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787369.585732:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678731904 00000100:00100000:1.0:1787787369.585742:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678731904 00000100:00100000:1.0:1787787369.585797:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 39 00000100:00100000:1.0:1787787369.585817:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2342:x1874630678731904:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787787369.585835:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787369.585868:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010c8cb7f/0xdeb1953cba4b1921 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35223 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787787369.585907:0:6674:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f7869, blocks: 0x1 00010000:00010000:1.0:1787787369.585935:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=281s v=(0 0) 00010000:00010000:1.0:1787787369.585939:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787369.585948:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010c8cb7f/0xdeb1953cba4b1921 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35223 expref: 8 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.585965:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010c8cb7f/0xdeb1953cba4b1921 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35223 expref: 8 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.585978:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1c800, rc 0) 00000100:00100000:1.0:1787787369.586043:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+8:2342:x1874630678731904:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 228us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787369.586051:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 39 00000100:00100000:2.0:1787787369.589366:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787369.589416:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678732160 00000100:00100000:0.0:1787787369.589425:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678732160 00000100:00100000:0.0:1787787369.589551:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 123 00000100:00100000:0.0:1787787369.589561:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+61:10552:x1874630678732160:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787787369.589660:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+61:10552:x1874630678732160:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 101us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787369.589668:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 123 00000100:00100000:2.0:1787787369.598267:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787369.599640:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678732288 00000100:00100000:1.0:1787787369.599667:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678732288 00000100:00100000:1.0:1787787369.599841:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 40 00000100:00100000:1.0:1787787369.599875:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+8:10552:x1874630678732288:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787787369.599906:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787369.599938:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001568381/0xdeb1953cba4b1928 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3522a expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.600004:0:6675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010c8cb7f/0xdeb1953cba4b1921 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35223 expref: 9 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.600052:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787369.600056:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787369.600062:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001568381/0xdeb1953cba4b1928 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3522a expref: 9 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.600096:0:6675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000010c8cb7f/0xdeb1953cba4b1921 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35223 expref: 9 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.600111:0:6675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000010c8cb7f/0xdeb1953cba4b1921 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35223 expref: 9 pid: 6674 timeout: 381 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787369.600139:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0702fd7840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6675:1874630694470272:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787787369.600253:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070860f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787369.604397:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787369.604500:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678732416 00000100:00100000:0.0:1787787369.604509:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678732416 00010000:00010000:0.0:1787787369.604552:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000010c8cb7f/0xdeb1953cba4b1921 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35223 expref: 10 pid: 6674 timeout: 381 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787369.604594:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 55 00000100:00100000:0.0:1787787369.604604:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+10:2344:x1874630678732416:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787369.604619:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787369.604641:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000010c8cb7f/0xdeb1953cba4b1921 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35223 expref: 10 pid: 6674 timeout: 381 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.604654:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000010c8cb7f/0xdeb1953cba4b1921 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35223 expref: 10 pid: 6674 timeout: 381 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.604681:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787369.604685:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787369.604693:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001568381/0xdeb1953cba4b1928 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3522a expref: 10 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.604719:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001568381/0xdeb1953cba4b1928 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3522a expref: 10 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.604756:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000001568381/0xdeb1953cba4b1928 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3522a expref: 10 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787369.604770:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06020eb0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5806:1874630694470400:192.168.206.10@tcp:105: 00000100:00100000:0.0:1787787369.605341:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073d9bce40 going to sleep for 11 seconds 00010000:00010000:1.0:1787787369.605557:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010c8cb7f/0xdeb1953cba4b1921 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35223 expref: 10 pid: 6674 timeout: 381 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787369.605574:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0702fd7840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6675:1874630694470272:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787787369.605599:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000001568381/0xdeb1953cba4b1928 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3522a expref: 9 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.605609:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1d600, rc 0) 00000100:00100000:1.0:1787787369.605643:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+9:10552:x1874630678732288:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 5793us (7385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787369.605662:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 40 00000100:00100000:2.0:1787787369.615919:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787369.616019:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678732544 00000100:00100000:3.0:1787787369.616029:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678732544 00002000:00100000:3.0:1787787369.616132:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9d073fd78000 x1874630678732544/t0(0) o4->c5599457-aa74-4a71-951f-faabe33e6ec7@192.168.206.10@tcp:230/0 lens 504/0 e 0 to 0 dl 1787787380 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787787369.616155:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d073fd78000 with x1874630678732544 ext(0->12) 00002000:00010000:3.0:1787787369.616160:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d073fd78000 00000100:00100000:3.0:1787787369.616217:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 3 00000100:00100000:3.0:1787787369.616227:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+9:2345:x1874630678732544:12345-192.168.206.10@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787787369.617073:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+11:2345:x1874630678732544:12345-192.168.206.10@tcp:4:lhsmtool_posix.0 Request processed in 843us (1159us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787787369.617083:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 3 00002000:00100000:3.0:1787787369.617092:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9d073fd78000 x1874630678732544/t4294967309(0) o4->c5599457-aa74-4a71-951f-faabe33e6ec7@192.168.206.10@tcp:230/0 lens 504/448 e 0 to 0 dl 1787787380 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787787369.617100:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d073fd78000 with x1874630678732544 ext(0->12) 00002000:00010000:3.0:1787787369.617104:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d073fd78000 00000100:00100000:0.0:1787787369.617696:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06020eb0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5806:1874630694470400:192.168.206.10@tcp:105: 00010000:00010000:0.0:1787787369.617720:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787369.617755:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+10:2344:x1874630678732416:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 13153us (13367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787369.617765:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 55 00000100:00100000:2.0:1787787369.621197:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787369.621320:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678732672 00000100:00100000:3.0:1787787369.621330:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678732672 00000100:00100000:3.0:1787787369.621403:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 124 00000100:00100000:3.0:1787787369.621414:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0734768780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+61:10552:x1874630678732672:12345-192.168.206.10@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787787369.666191:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:2.0:1787787369.666208:0:5842:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:2.0:1787787369.666220:0:5842:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1787787369.666265:0:5842:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d070860fb40 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1787787369.666271:0:5842:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d0707d9b600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d070860fa80 00000020:00080000:2.0:1787787369.666274:0:5842:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d0707d9bc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d070632c400 00000004:00080000:2.0:1787787369.666289:0:5842:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1787787369.666306:0:5842:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d073476e9c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1787787369.666308:0:5842:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d0737a0ae00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d073476ef00 00000020:00080000:2.0:1787787369.666311:0:5842:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d0707806e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d073fd72000 00000100:00100000:3.0:1787787369.666745:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0734768780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+15:10552:x1874630678732672:12345-192.168.206.10@tcp:44:lhsmtool_posix.0 Request processed in 45328us (45552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787369.666756:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 124 00000100:00100000:0.0:1787787369.666855:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07222a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694470528:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787787369.667377:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787369.667456:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787787369.667464:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07222a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694470656:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787787369.667501:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1787787369.667525:0:5853:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1787787369.667705:0:5853:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1787787369.668820:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787787369.668836:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073473f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694470784:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787787369.668898:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787369.668944:0:10776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694470528 00000100:00100000:2.0:1787787369.668951:0:10776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694470528 00000100:00100000:2.0:1787787369.669000:0:10776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694470656 00000100:00100000:2.0:1787787369.669004:0:10776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694470656 00000100:00100000:2.0:1787787369.669033:0:10776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694470784 00000100:00100000:2.0:1787787369.669036:0:10776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694470784 00000100:00100000:2.0:1787787369.669050:0:10776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787787369.669058:0:10776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06020eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3293:x1874630694470528:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787787369.669082:0:10776:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1787787369.669106:0:10776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c741093d/0xdeb1953cba4b192f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.669128:0:10776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3e28d15/0xdeb1953cba4b16f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35189 expref: 9 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.669138:0:10776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787787369.669142:0:10776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787787369.669146:0:10776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c741093d/0xdeb1953cba4b192f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.669177:0:10776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f3e28d15/0xdeb1953cba4b16f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35189 expref: 9 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.669191:0:10776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f3e28d15/0xdeb1953cba4b16f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35189 expref: 9 pid: 10776 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787369.669202:0:10776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073473e580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10776:1874630694470912:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787787369.669250:0:10776:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070860f240 going to sleep for 11 seconds 00000100:00080000:2.0:1787787369.669264:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787369.669277:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787787369.669285:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06020e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3293:x1874630694470656:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787787369.669429:0:6675:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787787369.669433:0:6675:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787787369 00002000:00010000:2.0:1787787369.669435:0:6675:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787787369.669461:0:6675:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787787369 -> 1787787369 00002000:00010000:2.0:1787787369.669464:0:6675:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787787369.669527:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06020e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3293:x1874630694470656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 243us (2026us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787787369.669536:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787787369.669553:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787787369.669560:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3292:x1874630694470784:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787787369.669572:0:6675:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:2.0:1787787369.669592:0:6675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8f7867, atime: 0x6a8f7867, ctime: 0x6a8f7867, blocks: 0x1 00010000:00010000:2.0:1787787369.669598:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000009518/0xdeb1953cba4b1936 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.669607:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=281s v=(0 0) 00010000:00010000:2.0:1787787369.669610:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787369.669615:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000009518/0xdeb1953cba4b1936 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.669628:0:6675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000009518/0xdeb1953cba4b1936 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.669638:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000009518/0xdeb1953cba4b1936 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.669659:0:6675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000009518/0xdeb1953cba4b1936 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.669675:0:6675:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787787369.670158:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3292:x1874630694470784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 596us (1257us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787787369.670166:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:2.0:1787787369.670187:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787369.670193:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000009518/0xdeb1953cba4b1936 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.670202:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39400 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:2.0:1787787369.670206:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000009518/0xdeb1953cba4b1936 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.670215:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000009518/0xdeb1953cba4b1936 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.670236:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000009518/0xdeb1953cba4b1936 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.670244:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000009518/0xdeb1953cba4b1936 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.670264:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787369.670273:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787369.670275:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787369.670308:0:3293:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1787787369.670314:0:3293:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:2.0:1787787369.670336:0:3293:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9d07222a2940 x1874630694470656/t4294967310(4294967310) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787787385 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787787369.670347:0:3293:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d07222a2940/2, rc 0, transno 4294967310 00000100:00100000:2.0:1787787369.670352:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07222a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694470656:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787787369.673226:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000004:00080000:1.0:1787787369.673514:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d073473f0c0/2, rc 0, transno 4294967304 00000100:00100000:1.0:1787787369.673524:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073473f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694470784:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787787369.675305:0:10776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073473e580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10776:1874630694470912:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787787369.675336:0:10776:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c741093d/0xdeb1953cba4b192f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787369.676279:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787369.676704:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678732928 00000100:00100000:3.0:1787787369.676712:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678732928 00010000:00010000:3.0:1787787369.676751:0:8496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f3e28d15/0xdeb1953cba4b16f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35189 expref: 10 pid: 10776 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787369.676793:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 56 00000100:00100000:3.0:1787787369.676984:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+10:2345:x1874630678732928:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787369.677000:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787369.677006:0:8496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f3e28d15/0xdeb1953cba4b16f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35189 expref: 10 pid: 10776 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.677020:0:8496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f3e28d15/0xdeb1953cba4b16f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35189 expref: 10 pid: 10776 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.677041:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3e28d15/0xdeb1953cba4b16f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35189 expref: 10 pid: 10776 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.677063:0:8496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787787369.677067:0:8496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787787369.677085:0:8496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c741093d/0xdeb1953cba4b192f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.677095:0:8496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c741093d/0xdeb1953cba4b192f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.677134:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787369.677187:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+9:2345:x1874630678732928:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 385us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787369.677195:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 56 00010000:00010000:3.0:1787787369.677295:0:10776:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c741093d/0xdeb1953cba4b192f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.677305:0:10776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c741093d/0xdeb1953cba4b192f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.677314:0:10776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c741093d/0xdeb1953cba4b192f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.677322:0:10776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c741093d/0xdeb1953cba4b192f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.677340:0:10776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787787369.678082:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678732800 00000100:00100000:2.0:1787787369.678091:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678732800 00000100:00100000:2.0:1787787369.678146:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 44 00000100:00100000:2.0:1787787369.678155:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+9:2344:x1874630678732800:12345-192.168.206.10@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787787369.678846:0:10776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06020eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3293:x1874630694470528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9787us (11468us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787787369.678855:0:10776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1787787369.678887:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787369.678899:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c741093d/0xdeb1953cba4b192f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.678908:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39200 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787369.678913:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c741093d/0xdeb1953cba4b192f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.678923:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c741093d/0xdeb1953cba4b192f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.678939:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c741093d/0xdeb1953cba4b192f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.678948:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c741093d/0xdeb1953cba4b192f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.678967:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787369.678968:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787369.678970:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787787369.679412:0:3293:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d07222a3c00/2, rc 0, transno 4294967311 00000100:00100000:2.0:1787787369.679421:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07222a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694470528:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1787787369.713030:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:0.0:1787787369.713210:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1787787369.713221:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1787787369.713227:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:1.0:1787787369.713391:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2344:x1874630678732800:12345-192.168.206.10@tcp:16:lhsmtool_posix.0 Request processed in 35231us (40171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787369.713403:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 44 00000100:00100000:3.0:1787787369.719706:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787369.719778:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678733184 00000100:00100000:2.0:1787787369.719788:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678733184 00000100:00100000:2.0:1787787369.719863:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 125 00000100:00100000:2.0:1787787369.719883:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+15:10552:x1874630678733184:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787787369.719938:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787369.719966:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b191a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3521c expref: 15 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.719993:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d07114aca00) 00010000:00010000:2.0:1787787369.720009:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787787369.720036:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b193d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.720067:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b193d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.720077:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b193d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787787369.720328:0:5820:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bdc4db4a reply state 00000000883ef4f7 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b193d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787369.720337:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787787369.722598:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+16:10552:x1874630678733184:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 2705us (2890us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1787787369.722610:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 125 00000100:00100000:2.0:1787787369.733180:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787369.733739:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678733312 00000100:00100000:3.0:1787787369.733749:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678733312 00000100:00100000:3.0:1787787369.733806:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 45 00000100:00100000:3.0:1787787369.733814:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2344:x1874630678733312:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787787369.734062:0:6673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787787369.734066:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1787787369 -> 1787787368 00002000:00010000:3.0:1787787369.734068:0:6673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787787367 00002000:00010000:3.0:1787787369.734082:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787787369 -> 1787787368 00002000:00010000:3.0:1787787369.734084:0:6673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787787369.734154:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2344:x1874630678733312:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 Request processed in 340us (983us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787787369.734162:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 45 00000100:00100000:3.0:1787787369.736568:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787369.737247:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678733568 00000100:00100000:1.0:1787787369.737257:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678733568 00000100:00100000:1.0:1787787369.737315:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 126 00000100:00100000:1.0:1787787369.737324:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+16:10552:x1874630678733568:12345-192.168.206.10@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787787369.737385:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1944 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.737400:0:9687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b18fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3520e expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.737410:0:9687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1944 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.737487:0:9687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b18fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3520e expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.737501:0:9687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b18fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3520e expref: 16 pid: 5819 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787369.737514:0:9687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0702fd4b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9687:1874630694471040:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787787369.737610:0:9687:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073fd9a0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787787369.741701:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b193d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.741718:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b193d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.741726:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b193d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.741732:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787369.741736:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b193d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.741744:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b193d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.741761:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d07114aca00) 00010000:00010000:0.0:1787787369.741764:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787369.741768:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b193d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.741775:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b193d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787369.742837:0:9687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0702fd4b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9687:1874630694471040:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787787369.742865:0:9687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1944 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787369.743273:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787369.743379:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678733696 00000100:00100000:3.0:1787787369.743387:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678733696 00010000:00010000:3.0:1787787369.743423:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b18fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3520e expref: 16 pid: 5819 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787369.744161:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 57 00000100:00100000:2.0:1787787369.744176:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b123840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+16:2345:x1874630678733696:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787369.744194:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787369.744203:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b18fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3520e expref: 16 pid: 5819 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.744217:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b18fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3520e expref: 16 pid: 5819 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.744239:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b18fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3520e expref: 16 pid: 5819 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.744272:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d07114aca00) 00010000:00010000:2.0:1787787369.744277:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1944 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.744285:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1944 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.744293:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1944 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.744327:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787369.744387:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b123840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+15:2345:x1874630678733696:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 215us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787369.744395:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 57 00010000:00010000:1.0:1787787369.744812:0:9687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1944 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.744821:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1944 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.744849:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1944 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.744856:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1944 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.744873:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1944 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.744880:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1de00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787369.744885:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1944 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.744893:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1944 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.744904:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d07114aca00) 00010000:00010000:1.0:1787787369.744906:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787787369.744910:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1944 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.744929:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1944 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787369.744974:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+14:10552:x1874630678733568:12345-192.168.206.10@tcp:55:lhsmtool_posix.0 Request processed in 7650us (8414us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787787369.744982:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 126 00000100:00100000:2.0:1787787369.748336:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787369.748417:0:10776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678733824 00000100:00100000:3.0:1787787369.748426:0:10776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678733824 00000100:00100000:3.0:1787787369.748520:0:10776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 46 00000100:00100000:3.0:1787787369.748531:0:10776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b120b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2345:x1874630678733824:12345-192.168.206.10@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787787369.748574:0:10776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000048260c51/0xdeb1953cba4b194b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.748594:0:10776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000001568381/0xdeb1953cba4b1928 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3522a expref: 7 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.748604:0:10776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787369.748609:0:10776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787787369.748614:0:10776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048260c51/0xdeb1953cba4b194b lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.748647:0:10776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000001568381/0xdeb1953cba4b1928 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3522a expref: 7 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.748674:0:10776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000001568381/0xdeb1953cba4b1928 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3522a expref: 7 pid: 6675 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787369.748690:0:10776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fd77840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10776:1874630694471168:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787787369.748764:0:10776:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07094a1180 going to sleep for 11 seconds 00000100:00100000:3.0:1787787369.752235:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787369.752390:0:10776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fd77840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10776:1874630694471168:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787787369.752435:0:10776:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000048260c51/0xdeb1953cba4b194b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787369.752683:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678733952 00000100:00100000:2.0:1787787369.752691:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678733952 00010000:00010000:2.0:1787787369.752723:0:8496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000001568381/0xdeb1953cba4b1928 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3522a expref: 8 pid: 6675 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787369.752796:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 58 00000100:00100000:2.0:1787787369.752804:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd76940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+8:2344:x1874630678733952:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787369.752817:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787369.752837:0:8496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000001568381/0xdeb1953cba4b1928 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3522a expref: 8 pid: 6675 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.752849:0:8496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000001568381/0xdeb1953cba4b1928 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3522a expref: 8 pid: 6675 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.752877:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001568381/0xdeb1953cba4b1928 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3522a expref: 8 pid: 6675 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.752891:0:8496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787787369.752896:0:8496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787787369.752901:0:8496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000048260c51/0xdeb1953cba4b194b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.752910:0:8496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048260c51/0xdeb1953cba4b194b lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.752941:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787369.753003:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd76940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2344:x1874630678733952:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 200us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787369.753012:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 58 00010000:00010000:3.0:1787787369.753364:0:10776:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000048260c51/0xdeb1953cba4b194b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.753375:0:10776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048260c51/0xdeb1953cba4b194b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.753401:0:10776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000048260c51/0xdeb1953cba4b194b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.753409:0:10776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048260c51/0xdeb1953cba4b194b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.753417:0:10776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048260c51/0xdeb1953cba4b194b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.753423:0:10776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708770000 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787369.753428:0:10776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048260c51/0xdeb1953cba4b194b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.753465:0:10776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048260c51/0xdeb1953cba4b194b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.753489:0:10776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048260c51/0xdeb1953cba4b194b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.753498:0:10776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048260c51/0xdeb1953cba4b194b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787369.753561:0:10776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b120b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2345:x1874630678733824:12345-192.168.206.10@tcp:1:lhsmtool_posix.0 Request processed in 5031us (5233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787369.753569:0:10776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 46 00000100:00100000:3.0:1787787369.756557:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787369.756643:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678734208 00000100:00100000:2.0:1787787369.756653:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678734208 00000100:00100000:2.0:1787787369.756760:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 127 00000100:00100000:2.0:1787787369.756770:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+14:10552:x1874630678734208:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787787369.756911:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1952 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.756930:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1952 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.756942:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1952 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.757323:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1959 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.757336:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b190c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35215 expref: 15 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.757344:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1959 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.757380:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b190c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35215 expref: 15 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.757394:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b190c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35215 expref: 15 pid: 5819 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787369.757407:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073c76c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1874630694471296:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787787369.757542:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070860f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787369.760709:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787369.760762:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073c76c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1874630694471296:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787787369.760789:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1959 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787369.760910:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678734336 00000100:00100000:3.0:1787787369.760917:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678734336 00010000:00010000:3.0:1787787369.760951:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b190c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35215 expref: 16 pid: 5819 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787369.760988:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 59 00000100:00100000:3.0:1787787369.760997:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+16:2345:x1874630678734336:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787369.761011:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787369.761018:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b190c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35215 expref: 16 pid: 5819 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.761030:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b190c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35215 expref: 16 pid: 5819 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.761068:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b190c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35215 expref: 16 pid: 5819 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.761082:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d07114aca00) 00010000:00010000:3.0:1787787369.761087:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1959 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.761096:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1959 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.761102:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1959 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.761133:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787369.761195:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+15:2345:x1874630678734336:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 198us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787369.761204:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 59 00010000:00010000:2.0:1787787369.761417:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1959 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.761425:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1959 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787787369.761660:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1787787369.761981:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1787787369.762030:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1787787369.762106:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073c76c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5820:1874630694471424:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787787369.762223:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787369.762349:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0703830c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787787369.762546:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694471424 00000100:00100000:3.0:1787787369.762553:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694471424 00000100:00100000:3.0:1787787369.763291:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787787369.763306:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073c76e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5820:x1874630694471424:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787787369.763464:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073c76e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5820:x1874630694471424:12345-0@lo:1000:mdt00_001.0 Request processed in 163us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787369.763471:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787787369.764045:0:5820:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1787787369.764052:0:5820:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d07222a2940, transno 4294967310 00000004:00080000:2.0:1787787369.764063:0:5820:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d07222a3c00, transno 4294967311 00000100:00100000:2.0:1787787369.764070:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073c76c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5820:1874630694471424:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787787369.765283:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1787787369.765369:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073c76c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5820:1874630694471552:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787787369.765432:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787369.765568:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070860f000 going to sleep for 11 seconds 00000100:00100000:0.0:1787787369.765655:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694471552 00000100:00100000:0.0:1787787369.765663:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694471552 00000100:00100000:0.0:1787787369.765704:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787787369.765714:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073c76f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5820:x1874630694471552:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787787369.765985:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073c76f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5820:x1874630694471552:12345-0@lo:1000:mdt00_001.0 Request processed in 271us (551us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1787787369.765992:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787787369.766073:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073c76c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5820:1874630694471552:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787787369.766111:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1959 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.766187:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1959 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.766197:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1959 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.766203:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787369.766208:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1959 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.766215:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1959 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.766245:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d07114aca00) 00010000:00010000:2.0:1787787369.766248:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787787369.766253:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1959 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.766260:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1959 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.766288:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c000/0xdeb1953cba4b189c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.766294:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c000/0xdeb1953cba4b189c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.766299:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c000/0xdeb1953cba4b189c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.766304:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1c000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787369.766307:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c000/0xdeb1953cba4b189c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.766312:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c000/0xdeb1953cba4b189c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.766320:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07114acf00) 00010000:00010000:2.0:1787787369.766322:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787787369.766330:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d400/0xdeb1953cba4b18a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351f9 expref: 18 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.766341:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d400/0xdeb1953cba4b18a3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351f9 expref: 18 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.766357:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d400/0xdeb1953cba4b18a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351f9 expref: 18 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.766384:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d400/0xdeb1953cba4b18a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351f9 expref: 18 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787369.766396:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e47840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1874630694471680:192.168.206.10@tcp:105: 00000100:00100000:2.0:1787787369.766569:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070595c900 going to sleep for 11 seconds 00000100:00100000:1.0:1787787369.770327:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787369.770826:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e47840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1874630694471680:192.168.206.10@tcp:105: 00010000:00010000:2.0:1787787369.770854:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c000/0xdeb1953cba4b189c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.770865:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c000/0xdeb1953cba4b189c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.771252:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b1960 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.771266:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b1960 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.771277:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b1960 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.771286:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b1960 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.771291:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b1960 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.771311:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b1960 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.771316:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd38400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787369.771320:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b1960 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.771327:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b1960 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.771339:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07114acf00) 00010000:00010000:2.0:1787787369.771342:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787369.771345:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b1960 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.771351:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b1960 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.771361:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1952 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.771367:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1952 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.771373:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1952 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.771378:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd38800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787369.771381:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1952 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.771397:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1952 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.771405:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07114acf00) 00010000:00010000:2.0:1787787369.771408:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787787369.771411:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1952 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.771416:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1952 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787369.771757:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+18:10552:x1874630678734208:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 14985us (15205us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1787787369.771768:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 127 00000020:00080000:2.0:1787787369.771775:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1787787369.771927:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678734464 00000100:00100000:3.0:1787787369.771934:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678734464 00000100:00100000:0.0:1787787369.772138:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 31 00000100:00100000:0.0:1787787369.772149:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+18:10551:x1874630678734464:12345-192.168.206.10@tcp:49:lfs.0 00000100:00100000:0.0:1787787369.772244:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+18:10551:x1874630678734464:12345-192.168.206.10@tcp:49:lfs.0 Request processed in 96us (1928us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787369.772251:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 31 00000040:00080000:1.0:1787787369.775215:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787787369.775227:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787787369.775780:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787787369.775791:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787787369.776328:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787369.776373:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787369.776503:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678734976 00000100:00100000:2.0:1787787369.776512:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678734976 00000100:00100000:2.0:1787787369.776557:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 128 00000100:00100000:2.0:1787787369.776565:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+18:10551:x1874630678734976:12345-192.168.206.10@tcp:58:lfs.0 00000040:00080000:2.0:1787787369.776904:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1787787369.776987:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+18:10551:x1874630678734976:12345-192.168.206.10@tcp:58:lfs.0 Request processed in 422us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787369.776995:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 128 00000100:00100000:0.0:1787787369.777265:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678734720 00000100:00100000:0.0:1787787369.777270:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678734720 00000100:00100000:0.0:1787787369.777309:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 32 00000100:00100000:0.0:1787787369.777316:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703166c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+18:10552:x1874630678734720:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787787369.777883:0:5823:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787787369.777991:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1787787369.778035:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1967 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.778051:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1967 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.778075:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1967 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.778083:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1967 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.778089:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1967 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.778094:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1967 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787369.778119:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787787369.778195:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703166c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+20:10552:x1874630678734720:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 878us (1870us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1787787369.778202:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 32 00000020:00080000:0.0:1787787369.778207:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787787369.778533:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787369.778542:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1967 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.778549:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fc400 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787369.778554:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1967 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.778562:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1967 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.778575:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d07096a0300) 00010000:00010000:3.0:1787787369.778578:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787787369.778582:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1967 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.778588:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1967 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787369.778611:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787369.778613:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787369.778615:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787369.814130:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787369.814227:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678735104 00000100:00100000:1.0:1787787369.814237:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678735104 00000100:00100000:1.0:1787787369.814295:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 129 00000100:00100000:1.0:1787787369.814305:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705976940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+20:10554:x1874630678735104:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787787369.814330:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787369.814349:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b196e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35231 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.814411:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d000/0xdeb1953cba4b1975 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.814425:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d000/0xdeb1953cba4b1975 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.814471:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d000/0xdeb1953cba4b1975 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.814515:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c400/0xdeb1953cba4b197c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.814523:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c400/0xdeb1953cba4b197c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.814530:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c400/0xdeb1953cba4b197c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.814814:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ca00/0xdeb1953cba4b1983 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.814826:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b188e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351f2 expref: 21 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.814835:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ca00/0xdeb1953cba4b1983 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.814868:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b188e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351f2 expref: 21 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.814881:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b188e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351f2 expref: 21 pid: 5820 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787369.814895:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0702fd5680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5819:1874630694471808:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787787369.814976:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073fd9a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787369.819644:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0702fd5680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5819:1874630694471808:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787787369.819673:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ca00/0xdeb1953cba4b1983 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787369.820181:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787369.820388:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678735360 00000100:00100000:0.0:1787787369.820397:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678735360 00000100:00100000:0.0:1787787369.820538:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 33 00000100:00100000:0.0:1787787369.820549:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705974b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+22:5580:x1874630678735360:12345-192.168.206.10@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787787369.820763:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705974b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+23:5580:x1874630678735360:12345-192.168.206.10@tcp:35:ldlm_bl.0 Request processed in 216us (583us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1787787369.820772:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 33 00000100:00100000:0.0:1787787369.823234:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787369.823382:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678735488 00000100:00100000:3.0:1787787369.823392:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678735488 00010000:00010000:3.0:1787787369.823429:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b188e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351f2 expref: 23 pid: 5820 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787369.823660:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 60 00000100:00100000:2.0:1787787369.823674:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705816850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+23:2345:x1874630678735488:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787369.823690:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787369.823697:0:8496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b188e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351f2 expref: 23 pid: 5820 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.823724:0:8496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b188e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351f2 expref: 23 pid: 5820 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.823748:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b188e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351f2 expref: 23 pid: 5820 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.823770:0:8496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07114acf00) 00010000:00010000:2.0:1787787369.823776:0:8496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ca00/0xdeb1953cba4b1983 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.823785:0:8496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ca00/0xdeb1953cba4b1983 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.823793:0:8496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ca00/0xdeb1953cba4b1983 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787369.823876:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787369.823968:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705816850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+22:2345:x1874630678735488:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 297us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787369.823976:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 60 00010000:00010000:1.0:1787787369.824051:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ca00/0xdeb1953cba4b1983 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.824060:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ca00/0xdeb1953cba4b1983 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787369.824102:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787787369.824107:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787787369.824184:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ca00/0xdeb1953cba4b1983 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.824197:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ca00/0xdeb1953cba4b1983 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.824206:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d000/0xdeb1953cba4b1975 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.824211:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d000/0xdeb1953cba4b1975 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.824217:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d000/0xdeb1953cba4b1975 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.824223:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1d000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787369.824227:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d000/0xdeb1953cba4b1975 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.824235:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d000/0xdeb1953cba4b1975 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.824245:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d07078d0f00) 00010000:00010000:1.0:1787787369.824255:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787369.824259:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d000/0xdeb1953cba4b1975 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.824265:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d000/0xdeb1953cba4b1975 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.824277:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c400/0xdeb1953cba4b197c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.824283:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c400/0xdeb1953cba4b197c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.824290:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c400/0xdeb1953cba4b197c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.824295:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1c400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787369.824298:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c400/0xdeb1953cba4b197c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.824304:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c400/0xdeb1953cba4b197c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.824312:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d07114ac500) 00010000:00010000:1.0:1787787369.824315:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787369.824318:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c400/0xdeb1953cba4b197c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.824324:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c400/0xdeb1953cba4b197c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.824362:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b196e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35231 expref: 22 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.824391:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ca00/0xdeb1953cba4b1983 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35231 expref: 21 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787369.824400:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07114acf00) 00010000:00010000:1.0:1787787369.824402:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787787369.824405:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1ca00, rc 0) 00000100:00100000:1.0:1787787369.824492:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705976940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+21:10554:x1874630678735104:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 10132us (10315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787369.824502:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 129 00000100:00100000:1.0:1787787369.852817:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07059743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694471936:0@lo:400:kworker.0 00000100:00100000:1.0:1787787369.852908:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787369.853007:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694471936 00000100:00100000:2.0:1787787369.853015:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694471936 00000100:00100000:2.0:1787787369.853073:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1787787369.853083:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3292:x1874630694471936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787369.853343:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694472320:0@lo:400:kworker.0 00000100:00100000:0.0:1787787369.853379:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787369.853431:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694472320 00000100:00100000:0.0:1787787369.853435:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694472320 00000100:00100000:0.0:1787787369.853501:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787787369.853509:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06020e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3291:x1874630694472320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787369.853549:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06020e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3291:x1874630694472320:12345-0@lo:400:kworker.0 Request processed in 42us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787369.853556:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787787369.853599:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694472320:0@lo:400:kworker.0 00000100:00100000:2.0:1787787369.860073:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3292:x1874630694471936:12345-0@lo:400:kworker.0 Request processed in 6982us (7156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787369.860089:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1787787369.861367:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0705975680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874630694472064:0@lo:400:kworker.0 00000100:00100000:2.0:1787787369.861425:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787369.861491:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787787369.861498:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1874630694472192:0@lo:400:kworker.0 00000100:00100000:2.0:1787787369.861524:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787369.861565:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694472064 00000100:00100000:2.0:1787787369.861574:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694472064 00000100:00100000:2.0:1787787369.861619:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694472192 00000100:00100000:2.0:1787787369.861622:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694472192 00000100:00100000:2.0:1787787369.861655:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787787369.861664:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874630694472064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787369.861715:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874630694472064:12345-0@lo:400:kworker.0 Request processed in 52us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787369.861723:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787787369.861737:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787787369.861743:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874630694472192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787369.861770:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874630694472192:12345-0@lo:400:kworker.0 Request processed in 28us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787369.861777:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:2.0:1787787369.861793:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787369.861822:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1874630694472192:0@lo:400:kworker.0 00000100:00100000:2.0:1787787369.861833:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0705975680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874630694472064:0@lo:400:kworker.0 00000100:00100000:0.0:1787787369.863250:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07059743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694471936:0@lo:400:kworker.0 00000100:00100000:1.0:1787787369.869054:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787787369.869223:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fd7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694472576:0@lo:400:kworker.0 00000100:00100000:3.0:1787787369.869285:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787369.870270:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694472576 00000100:00100000:0.0:1787787369.870281:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694472576 00000100:00100000:0.0:1787787369.870340:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787787369.870350:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a08b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3293:x1874630694472576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787369.870420:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a08b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3293:x1874630694472576:12345-0@lo:400:kworker.0 Request processed in 72us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787369.870427:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787787369.871761:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fd7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694472576:0@lo:400:kworker.0 00000100:00100000:1.0:1787787369.872723:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06020ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1874630694472448:0@lo:400:kworker.0 00000100:00100000:1.0:1787787369.872797:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787369.873276:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694472448 00000100:00100000:2.0:1787787369.873284:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694472448 00000100:00100000:2.0:1787787369.873403:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787787369.873426:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1874630694472448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787369.873530:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1874630694472448:12345-0@lo:400:kworker.0 Request processed in 106us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787369.873538:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787787369.873671:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06020ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1874630694472448:0@lo:400:kworker.0 00000100:00080000:0.0:1787787369.873732:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787787370.109021:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787370.366333:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787787370.366520:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0702fd7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694472704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787370.366586:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787370.366699:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694472704 00000100:00100000:2.0:1787787370.366707:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694472704 00000100:00100000:2.0:1787787370.366766:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787787370.366775:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1874630694472704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787787370.366811:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787370.366869:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1874630694472704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787370.366876:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787787370.366922:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0702fd7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694472704:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787787370.366966:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1787787370.581917:0:12092:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787787370.581926:0:12092:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787787370.581972:0:12092:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787787370.581977:0:12092:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787787370.812820:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787787370.812830:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787787370.812867:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787787370.812873:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787787370.812989:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0702fd4b40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874630694472832:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787787370.813115:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0704e2f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787370.816507:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0702fd4b40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874630694472832:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787787370.817327:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787370.817408:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678735616 00000100:00100000:2.0:1787787370.817415:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678735616 00000100:00100000:2.0:1787787370.817768:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 130 00000100:00100000:2.0:1787787370.817779:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+21:10566:x1874630678735616:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787787370.817812:0:5820:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787787370.818070:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+21:10566:x1874630678735616:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 292us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787370.818079:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 130 00000100:00100000:0.0:1787787370.828928:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787370.829189:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678735872 00000100:00100000:2.0:1787787370.829199:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678735872 00000100:00100000:2.0:1787787370.829259:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 131 00000100:00100000:2.0:1787787370.829269:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+21:10566:x1874630678735872:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787787370.829300:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787370.829324:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b198a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35238 expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787370.829415:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1991 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787370.829429:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1991 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787370.829487:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1991 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787370.829500:0:9687:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787787370.829797:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b198a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35238 expref: 24 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787370.829815:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1991 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35238 expref: 23 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787370.829823:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07114acf00) 00010000:00010000:2.0:1787787370.829826:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787787370.829829:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd38600, rc 0) 00000100:00100000:2.0:1787787370.829934:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+23:10566:x1874630678735872:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 666us (1015us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1787787370.829950:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 131 00000100:00100000:0.0:1787787370.839083:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787370.839334:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678736000 00000100:00100000:3.0:1787787370.839343:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678736000 00000100:00100000:3.0:1787787370.839406:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:3.0:1787787370.839416:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+23:2345:x1874630678736000:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787370.839430:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787370.840807:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1991 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35238 expref: 23 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787370.840832:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07114acf00) 00010000:00010000:3.0:1787787370.840837:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787370.842599:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+22:2345:x1874630678736000:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 3176us (3515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787370.842628:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:1.0:1787787370.845104:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787370.845405:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678736256 00000100:00100000:2.0:1787787370.845415:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678736256 00000100:00100000:2.0:1787787370.845514:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 132 00000100:00100000:2.0:1787787370.845525:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+22:10566:x1874630678736256:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787787370.845607:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b199f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787370.845624:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b199f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787370.845636:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b199f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787370.846282:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b199f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787370.846291:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b199f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787370.846298:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b199f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787370.846304:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787370.846308:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b199f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787370.846321:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b199f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787370.846341:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07114acf00) 00010000:00010000:2.0:1787787370.846344:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787787370.846349:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b199f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787370.846354:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b199f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787370.847344:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+23:10566:x1874630678736256:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 1814us (2240us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1787787370.847356:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 132 00000040:00080000:1.0:1787787370.848169:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787787370.848175:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1787787370.850011:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000040:00080000:1.0:1787787370.850276:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787787370.850301:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787787370.851659:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678736512 00000100:00100000:2.0:1787787370.851671:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678736512 00000100:00100000:2.0:1787787370.851849:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 34 00000100:00100000:2.0:1787787370.851859:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+23:10566:x1874630678736512:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787787370.852096:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+24:10566:x1874630678736512:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 238us (2091us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1787787370.852105:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 34 00010000:00010000:2.0:1787787371.133580:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787371.388999:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787787371.389022:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694472960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787787371.389095:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787371.389163:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694472960 00000100:00100000:2.0:1787787371.389171:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694472960 00000100:00080000:3.0:1787787371.389212:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787371.389239:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787787371.389245:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1787787371.389251:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06020ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3292:x1874630694472960:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787787371.389256:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:2.0:1787787371.389300:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787371.389354:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06020ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3292:x1874630694472960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787371.389380:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787787371.389433:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694472960:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787787372.158556:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787787372.527771:0:12145:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787787372.527780:0:12145:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787787372.527824:0:12145:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787787372.527829:0:12145:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787787372.704779:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787372.704867:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678736768 00000100:00100000:1.0:1787787372.704876:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678736768 00000100:00100000:1.0:1787787372.704954:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 133 00000100:00100000:1.0:1787787372.704965:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07222a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+24:10586:x1874630678736768:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787787372.704989:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787372.705009:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1cc00/0xdeb1953cba4b19a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3523f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787787372.705192:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787787372.705220:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c000/0xdeb1953cba4b19ad lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787372.705236:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c000/0xdeb1953cba4b19ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787372.705247:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c000/0xdeb1953cba4b19ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787372.705259:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787787372.705365:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1cc00/0xdeb1953cba4b19a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3523f expref: 27 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787372.705380:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c000/0xdeb1953cba4b19ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3523f expref: 26 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787372.705389:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07114acf00) 00010000:00010000:1.0:1787787372.705391:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787787372.705394:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1c000, rc 0) 00000100:00100000:1.0:1787787372.705513:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07222a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+26:10586:x1874630678736768:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 551us (751us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1787787372.705535:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 133 00000100:00100000:1.0:1787787372.712516:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787372.713039:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678736896 00000100:00100000:2.0:1787787372.713050:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678736896 00000100:00100000:2.0:1787787372.713111:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 134 00000100:00100000:2.0:1787787372.713121:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fefcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+26:10586:x1874630678736896:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:2.0:1787787372.713185:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b19bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787372.713201:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b19bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787372.713212:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b19bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787372.713239:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b19bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787372.713246:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b19bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787372.713253:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b19bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787372.713259:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd38200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787372.713277:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b19bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787372.713285:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b19bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787372.713296:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07114acf00) 00010000:00010000:2.0:1787787372.713299:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787787372.713304:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b19bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787372.713310:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b19bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787372.713380:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fefcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+26:10586:x1874630678736896:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 260us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787372.713388:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 134 00000100:00100000:0.0:1787787372.807551:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787372.807812:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678737024 00000100:00100000:3.0:1787787372.807821:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678737024 00000100:00100000:3.0:1787787372.807932:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 47 00000100:00100000:3.0:1787787372.807943:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07222a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2345:x1874630678737024:12345-192.168.206.10@tcp:101:cat.0 00010000:00010000:3.0:1787787372.807972:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787372.807991:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048260c51/0xdeb1953cba4b19c2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35246 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787787372.808015:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8f7868, atime: 0x6a8f7867, ctime: 0x6a8f7868, blocks: 0xb 00010000:00010000:3.0:1787787372.808034:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=285s v=(0 0) 00010000:00010000:3.0:1787787372.808039:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787372.808048:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048260c51/0xdeb1953cba4b19c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35246 expref: 7 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787372.808066:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000048260c51/0xdeb1953cba4b19c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35246 expref: 7 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787372.808078:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708770000, rc 0) 00000100:00100000:3.0:1787787372.808146:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07222a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2345:x1874630678737024:12345-192.168.206.10@tcp:101:cat.0 Request processed in 205us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787372.808154:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 47 00000100:00080000:0.0:1787787372.809510:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787787372.816709:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787372.820605:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678737152 00000100:00100000:3.0:1787787372.820622:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678737152 00002000:00100000:3.0:1787787372.820678:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9d073fe80000 x1874630678737152/t0(0) o3->c5599457-aa74-4a71-951f-faabe33e6ec7@192.168.206.10@tcp:233/0 lens 488/0 e 0 to 0 dl 1787787383 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787787372.820689:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d073fe80000 with x1874630678737152 ext(0->4095) 00002000:00010000:3.0:1787787372.820695:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d073fe80000 00000100:00100000:3.0:1787787372.820732:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:3.0:1787787372.820741:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2344:x1874630678737152:12345-192.168.206.10@tcp:3:cat.0 00000100:00100000:3.0:1787787372.821267:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2344:x1874630678737152:12345-192.168.206.10@tcp:3:cat.0 Request processed in 526us (4565us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787787372.821336:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 4 00002000:00100000:3.0:1787787372.821346:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9d073fe80000 x1874630678737152/t0(0) o3->c5599457-aa74-4a71-951f-faabe33e6ec7@192.168.206.10@tcp:233/0 lens 488/4536 e 0 to 0 dl 1787787383 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787787372.821355:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d073fe80000 with x1874630678737152 ext(0->4095) 00002000:00010000:3.0:1787787372.821359:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d073fe80000 00000001:00080000:1.0:1787787372.978044:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1787787372.978065:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:3.0:1787787373.180834:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787373.538703:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787373.538739:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787373.538775:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787373.538802:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787373.538829:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787373.538856:0:10776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678737664 00000100:00100000:2.0:1787787373.538865:0:10776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678737664 00000100:00100000:2.0:1787787373.538916:0:10776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678737536 00000100:00100000:2.0:1787787373.538919:0:10776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678737536 00000100:00100000:2.0:1787787373.538953:0:10776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 73 00000100:00100000:2.0:1787787373.538963:0:10776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e45a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2343:x1874630678737664:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787787373.539024:0:10776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e45a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2343:x1874630678737664:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 63us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787373.539048:0:10776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 73 00000100:00100000:2.0:1787787373.539072:0:10776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 74 00000100:00100000:2.0:1787787373.539077:0:10776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2343:x1874630678737536:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787787373.539119:0:10776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2343:x1874630678737536:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 42us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787373.539125:0:10776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 74 00000100:00100000:3.0:1787787373.539884:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678737408 00000100:00100000:3.0:1787787373.539892:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678737408 00000100:00100000:3.0:1787787373.539937:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678737792 00000100:00100000:3.0:1787787373.539940:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678737792 00000100:00100000:3.0:1787787373.539963:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 129 00000100:00100000:3.0:1787787373.539969:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e44f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+26:2343:x1874630678737408:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787373.540020:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e44f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+26:2343:x1874630678737408:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 51us (1325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787373.540026:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 129 00000100:00100000:3.0:1787787373.540040:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 130 00000100:00100000:3.0:1787787373.540046:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07059743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2343:x1874630678737792:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787373.540070:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07059743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2343:x1874630678737792:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 24us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787373.540076:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 130 00000100:00100000:1.0:1787787373.540786:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678737280 00000100:00100000:1.0:1787787373.540792:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678737280 00000100:00100000:1.0:1787787373.540828:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 283 00000100:00100000:1.0:1787787373.540836:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2343:x1874630678737280:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787787373.540868:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2343:x1874630678737280:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 33us (2093us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787373.540875:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 283 00000100:00080000:0.0:1787787373.541109:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787787373.541114:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787787374.205598:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787374.974931:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0705975680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694473088:0@lo:400:kworker.0 00000100:00100000:2.0:1787787374.975173:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787374.975248:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694473088 00000100:00100000:2.0:1787787374.975255:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694473088 00000100:00100000:2.0:1787787374.975302:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1787787374.975312:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3292:x1874630694473088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787374.975369:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3292:x1874630694473088:12345-0@lo:400:kworker.0 Request processed in 58us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787374.975376:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1787787374.975422:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0705975680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694473088:0@lo:400:kworker.0 00000100:00100000:3.0:1787787374.976470:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0708b58b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694473472:0@lo:400:kworker.0 00000100:00100000:2.0:1787787374.976594:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0705975680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874630694473216:0@lo:400:kworker.0 00000100:00100000:1.0:1787787374.978961:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d070596d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1874630694473344:0@lo:400:kworker.0 00000100:00100000:0.0:1787787374.980044:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707091e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1874630694473600:0@lo:400:kworker.0 00000100:00100000:2.0:1787787374.980980:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787374.981650:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787374.981715:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787374.981747:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787787374.981759:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07070930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694473728:0@lo:400:kworker.0 00000100:00100000:1.0:1787787374.981788:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787374.981944:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694473216 00000100:00100000:1.0:1787787374.981955:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694473216 00000100:00100000:1.0:1787787374.982000:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694473344 00000100:00100000:1.0:1787787374.982003:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694473344 00000100:00100000:1.0:1787787374.982032:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787787374.982037:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787374.982041:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b123840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874630694473216:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787787374.982068:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787787374.982097:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b123840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874630694473216:12345-0@lo:400:kworker.0 Request processed in 57us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787374.982105:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787787374.982105:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694473600 00000100:00100000:0.0:1787787374.982108:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694473600 00000100:00100000:1.0:1787787374.982125:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787787374.982139:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073feff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1874630694473344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787374.982143:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787787374.982150:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1874630694473600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787374.982179:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073feff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1874630694473344:12345-0@lo:400:kworker.0 Request processed in 40us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787374.982184:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1874630694473600:12345-0@lo:400:kworker.0 Request processed in 36us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787374.982185:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787787374.982190:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:0.0:1787787374.982204:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787787374.982224:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d070596d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1874630694473344:0@lo:400:kworker.0 00000100:00100000:0.0:1787787374.982224:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707091e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1874630694473600:0@lo:400:kworker.0 00000100:00100000:1.0:1787787374.982281:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694473472 00000100:00100000:1.0:1787787374.982284:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694473472 00000100:00100000:1.0:1787787374.982313:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694473728 00000100:00100000:1.0:1787787374.982316:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694473728 00000100:00100000:1.0:1787787374.982335:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787787374.982341:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707091680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3291:x1874630694473472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787374.982371:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707091680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3291:x1874630694473472:12345-0@lo:400:kworker.0 Request processed in 31us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787374.982376:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787787374.982387:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787787374.982392:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fefe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694473728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787374.982420:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fefe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694473728:12345-0@lo:400:kworker.0 Request processed in 29us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787374.982426:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787787374.984178:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0705975680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874630694473216:0@lo:400:kworker.0 00000100:00100000:2.0:1787787374.984251:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0708b58b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694473472:0@lo:400:kworker.0 00000100:00080000:1.0:1787787374.985018:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787787374.985025:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787787375.000156:0:3294:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1787787375.000169:0:3294:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1787787375.000188:0:3294:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d073473f0c0, transno 4294967304 00000100:00100000:0.0:1787787375.000596:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07070930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694473728:0@lo:400:kworker.0 00000001:00080000:1.0:1787787375.061530:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:1.0:1787787375.061547:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:2.0:1787787375.061879:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967409 is committed 00000020:00080000:2.0:1787787375.061893:0:5842:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:2.0:1787787375.061922:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1787787375.061945:0:5842:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d0703830c00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1787787375.061949:0:5842:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d0707d8e000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d0703830780 00000020:00080000:2.0:1787787375.061953:0:5842:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d0707d8e500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d060259d400 00000020:00080000:0.0:1787787375.062014:0:5853:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1787787375.062412:0:5853:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1787787375.230152:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787375.486109:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694473856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787787375.486173:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787375.486351:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694473856 00000100:00100000:0.0:1787787375.486358:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694473856 00000100:00100000:0.0:1787787375.486412:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787787375.486422:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0708b58b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694473856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787787375.486484:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787787375.486543:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0708b58b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694473856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787375.486559:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787787375.486729:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694473856:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787787376.252670:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787376.509295:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787787376.509318:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707092d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694473984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787787376.509395:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787376.509641:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694473984 00000100:00100000:1.0:1787787376.509648:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694473984 00000100:00100000:1.0:1787787376.509707:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787787376.509715:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe82d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694473984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787787376.509759:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787787376.509804:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe82d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694473984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787376.509811:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1787787376.509903:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787787376.509962:0:3292:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:3.0:1787787376.509968:0:3292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:3.0:1787787376.509993:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707092d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694473984:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1787787377.027212:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787787377.027225:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787787377.027689:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1787787377.027698:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787787377.278225:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787377.811490:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787377.811600:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678737920 00000100:00100000:1.0:1787787377.811612:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678737920 00000100:00100000:1.0:1787787377.811714:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 135 00000100:00100000:1.0:1787787377.811725:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073473f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+13:10231:x1874630678737920:12345-192.168.206.10@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787787377.811871:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073473f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+13:10231:x1874630678737920:12345-192.168.206.10@tcp:60:lhsmtool_posix.0 Request processed in 147us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787377.811880:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 135 00000100:00080000:0.0:1787787377.812769:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787377.815551:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787377.815668:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678738176 00000100:00100000:2.0:1787787377.815682:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678738176 00000100:00100000:2.0:1787787377.815774:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 35 00000100:00100000:2.0:1787787377.815787:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+13:10231:x1874630678738176:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787787377.816385:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+14:10231:x1874630678738176:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 596us (845us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1787787377.816396:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 35 00010000:00010000:2.0:1787787378.300672:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787378.303302:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787378.303410:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678738304 00000100:00100000:1.0:1787787378.303424:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678738304 00000100:00100000:1.0:1787787378.303573:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 136 00000100:00100000:1.0:1787787378.303584:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707092d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:11038:x1874630678738304:12345-192.168.206.10@tcp:101:lsof.0 00010000:00010000:1.0:1787787378.303604:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787378.303624:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b19c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3524d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787378.303696:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1cc00/0xdeb1953cba4b19d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787378.303711:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1cc00/0xdeb1953cba4b19d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787378.303721:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1cc00/0xdeb1953cba4b19d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787378.304156:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787787378.304161:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787787378.304258:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1cc00/0xdeb1953cba4b19d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787378.304285:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b19c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3524d expref: 7 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787378.304302:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1cc00/0xdeb1953cba4b19d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3524d expref: 6 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787378.304311:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:1.0:1787787378.304314:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787787378.304317:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1cc00, rc 0) 00000100:00100000:1.0:1787787378.304384:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707092d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:267c8212-9bde-4b8e-bca1-0730dc2554b7+6:11038:x1874630678738304:12345-192.168.206.10@tcp:101:lsof.0 Request processed in 801us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787378.304392:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 136 00000100:00080000:0.0:1787787378.304539:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787787378.664542:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787378.664657:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787378.664698:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787378.664734:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787378.664797:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787378.665255:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678738688 00000100:00100000:2.0:1787787378.665269:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678738688 00000100:00100000:2.0:1787787378.665344:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678738816 00000100:00100000:2.0:1787787378.665347:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678738816 00000100:00100000:2.0:1787787378.665377:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 77 00000100:00100000:2.0:1787787378.665387:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fefde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2343:x1874630678738688:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787787378.665515:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fefde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2343:x1874630678738688:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 129us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787378.665524:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 77 00000100:00100000:2.0:1787787378.665555:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 78 00000100:00100000:2.0:1787787378.665563:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070303c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2343:x1874630678738816:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787787378.665593:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070303c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2343:x1874630678738816:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 31us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787378.665600:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 78 00000100:00080000:2.0:1787787378.665617:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787787378.665621:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787787378.665883:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678738944 00000100:00100000:3.0:1787787378.665888:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678738944 00000100:00100000:3.0:1787787378.665926:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678738560 00000100:00100000:3.0:1787787378.665930:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678738560 00000100:00100000:3.0:1787787378.665954:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 134 00000100:00100000:3.0:1787787378.665961:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fefe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267c8212-9bde-4b8e-bca1-0730dc2554b7+6:2343:x1874630678738944:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787378.666002:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fefe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267c8212-9bde-4b8e-bca1-0730dc2554b7+6:2343:x1874630678738944:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 42us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787378.666009:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 134 00000100:00100000:3.0:1787787378.666021:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 135 00000100:00100000:3.0:1787787378.666028:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070596d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+14:2343:x1874630678738560:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787378.666054:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070596d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+14:2343:x1874630678738560:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 27us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787378.666061:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 135 00000100:00100000:0.0:1787787378.680468:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678738432 00000100:00100000:0.0:1787787378.680487:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678738432 00000100:00100000:0.0:1787787378.680588:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 285 00000100:00100000:0.0:1787787378.680600:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703097050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2343:x1874630678738432:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787787378.680704:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703097050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2343:x1874630678738432:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 107us (16177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787378.680713:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 285 00010000:00010000:2.0:1787787379.324723:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787380.095637:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737ea4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694474496:0@lo:400:kworker.0 00000100:00100000:2.0:1787787380.095732:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787380.095816:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787787380.095824:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0705975680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694474112:0@lo:400:kworker.0 00000100:00100000:2.0:1787787380.095871:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787380.095896:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737ea5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1874630694474624:0@lo:400:kworker.0 00000100:00100000:2.0:1787787380.095924:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787380.095951:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fd743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874630694474240:0@lo:400:kworker.0 00000100:00100000:2.0:1787787380.095977:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787380.095993:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737ea4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694474752:0@lo:400:kworker.0 00000100:00100000:2.0:1787787380.096016:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787380.096037:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787787380.096042:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fd76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1874630694474368:0@lo:400:kworker.0 00000100:00100000:2.0:1787787380.096086:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787380.096121:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694474112 00000100:00100000:2.0:1787787380.096130:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694474112 00000100:00100000:2.0:1787787380.096185:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1787787380.096194:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3291:x1874630694474112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787380.096258:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3291:x1874630694474112:12345-0@lo:400:kworker.0 Request processed in 64us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787380.096267:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1787787380.096306:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694474496 00000100:00100000:2.0:1787787380.096309:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694474496 00000100:00100000:2.0:1787787380.096349:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694474752 00000100:00100000:2.0:1787787380.096352:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694474752 00000100:00100000:2.0:1787787380.096372:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787787380.096378:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737ea70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694474496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787380.096411:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737ea70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694474496:12345-0@lo:400:kworker.0 Request processed in 33us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787380.096418:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787787380.096464:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787787380.096469:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694474624 00000100:00100000:2.0:1787787380.096472:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737ea7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694474752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787380.096473:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694474624 00000100:00100000:2.0:1787787380.096508:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737ea7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694474752:12345-0@lo:400:kworker.0 Request processed in 38us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787380.096515:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787787380.096567:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737ea4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694474752:0@lo:400:kworker.0 00000100:00100000:2.0:1787787380.096601:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0705975680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694474112:0@lo:400:kworker.0 00000100:00100000:2.0:1787787380.096615:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737ea4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694474496:0@lo:400:kworker.0 00000100:00100000:3.0:1787787380.096697:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694474240 00000100:00100000:3.0:1787787380.096701:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694474240 00000100:00100000:3.0:1787787380.096724:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694474368 00000100:00100000:3.0:1787787380.096727:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694474368 00000100:00100000:3.0:1787787380.096755:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787787380.096762:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737ea5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1874630694474624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787380.096813:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737ea5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1874630694474624:12345-0@lo:400:kworker.0 Request processed in 52us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787380.096820:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787787380.096832:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787787380.096838:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737ea7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874630694474240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787380.096876:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737ea7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874630694474240:12345-0@lo:400:kworker.0 Request processed in 38us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787380.096882:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787787380.096897:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787787380.096903:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737ea6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874630694474368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787380.096929:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737ea6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874630694474368:12345-0@lo:400:kworker.0 Request processed in 26us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787380.096935:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787787380.096961:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fd76940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1874630694474368:0@lo:400:kworker.0 00000100:00100000:3.0:1787787380.096970:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fd743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874630694474240:0@lo:400:kworker.0 00000100:00080000:2.0:1787787380.097707:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787787380.097715:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787787380.097717:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787380.097767:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737ea5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1874630694474624:0@lo:400:kworker.0 00000020:00080000:2.0:1787787380.121842:0:5842:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:2.0:1787787380.121902:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1787787380.122176:0:5853:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1787787380.122192:0:5853:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1787787380.348918:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787380.607758:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe00f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694474880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787787380.607874:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787380.608158:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694474880 00000100:00100000:0.0:1787787380.608170:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694474880 00000100:00100000:0.0:1787787380.608241:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787787380.608254:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737ea5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694474880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787787380.608303:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787787380.608381:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737ea5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694474880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787380.608389:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787787380.608627:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe00f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694474880:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787787381.372964:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787381.635159:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fe03840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694475008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787787381.635239:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787381.636196:0:12107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694475008 00000100:00100000:2.0:1787787381.636341:0:12107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694475008 00000100:00100000:2.0:1787787381.636406:0:12107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787787381.636426:0:12107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070303d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694475008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787787381.636480:0:12107:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787381.642587:0:12107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070303d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694475008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6165us (7340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787381.642602:0:12107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787787381.644024:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fe03840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694475008:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1787787381.891329:0:12346:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 19:36:20 (1787787380) 00010000:00010000:2.0:1787787382.398847:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787383.232627:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787383.233180:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678739200 00000100:00100000:0.0:1787787383.233190:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678739200 00000100:00100000:0.0:1787787383.233310:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 137 00000100:00100000:0.0:1787787383.233334:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07070930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+13:11303:x1874630678739200:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787787383.233355:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787383.233375:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b19d7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35254 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787383.233488:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b19de lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787383.233503:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b19de lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787383.233515:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b19de lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787383.233530:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b19e5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787383.233537:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b19e5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787383.233544:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b19e5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787383.233959:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b19ec lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787383.233970:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b19ec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787383.233978:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b19ec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787383.233998:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00000100:00080000:2.0:1787787383.234370:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787787383.240834:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b19de lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787383.240853:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b19de lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787383.240862:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b19de lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787383.240868:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fc400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787383.240873:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b19de lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787383.240880:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b19de lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787383.240896:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d07078d0800) 00010000:00010000:1.0:1787787383.240899:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787383.240904:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b19de lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787383.240911:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b19de lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787383.241701:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b19e5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787383.241711:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b19e5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787383.241729:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b19e5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787383.241734:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fcc00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787383.241738:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b19e5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787383.241743:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b19e5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787383.241753:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9d07096a0800) 00010000:00010000:1.0:1787787383.241756:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787383.241759:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b19e5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787383.241764:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b19e5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787383.242191:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b19d7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35254 expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787383.242208:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b19ec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35254 expref: 15 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787383.242216:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d071b71da00) 00010000:00010000:1.0:1787787383.242218:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787383.242221:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d07059fc200, rc 0) 00000100:00100000:1.0:1787787383.242297:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07070930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+15:11303:x1874630678739200:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 8966us (9678us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1787787383.242314:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 137 00000100:00100000:1.0:1787787383.245830:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787383.245956:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678739328 00000100:00100000:2.0:1787787383.245965:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678739328 00000100:00100000:2.0:1787787383.246032:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 138 00000100:00100000:2.0:1787787383.246042:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070303c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+15:11303:x1874630678739328:12345-192.168.206.10@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787787383.246148:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070303c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+15:11303:x1874630678739328:12345-192.168.206.10@tcp:59:lhsmtool_posix.0 Request processed in 108us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787383.246155:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 138 00000100:00100000:3.0:1787787383.246777:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787383.247891:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678739456 00000100:00100000:0.0:1787787383.247902:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678739456 00000100:00100000:0.0:1787787383.247966:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:0.0:1787787383.247976:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707091e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+15:2343:x1874630678739456:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787383.247991:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787383.248027:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b19ec lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35254 expref: 15 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787383.248061:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d071b71da00) 00010000:00010000:0.0:1787787383.248066:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787383.248128:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707091e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+14:2343:x1874630678739456:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 153us (1352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787383.248136:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 10 00010000:00010000:3.0:1787787383.420778:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787383.782017:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787383.782066:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787383.782086:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787383.782104:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787383.782135:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787383.782159:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678740096 00000100:00100000:0.0:1787787383.782167:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678740096 00000100:00100000:0.0:1787787383.782209:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678739712 00000100:00100000:0.0:1787787383.782211:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678739712 00000100:00100000:0.0:1787787383.782231:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 139 00000100:00100000:0.0:1787787383.782240:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe03840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:267c8212-9bde-4b8e-bca1-0730dc2554b7+6:2345:x1874630678740096:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787787383.782304:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe03840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:267c8212-9bde-4b8e-bca1-0730dc2554b7+6:2345:x1874630678740096:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 65us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787383.782317:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 139 00000100:00100000:0.0:1787787383.782332:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 140 00000100:00100000:0.0:1787787383.782338:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe00f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+14:2345:x1874630678739712:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787787383.782360:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe00f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+14:2345:x1874630678739712:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 23us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787383.782366:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 140 00000100:00100000:2.0:1787787383.783768:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678739840 00000100:00100000:2.0:1787787383.783778:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678739840 00000100:00100000:2.0:1787787383.783826:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678739968 00000100:00100000:2.0:1787787383.783829:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678739968 00000100:00100000:2.0:1787787383.783852:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 81 00000100:00100000:2.0:1787787383.783859:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2345:x1874630678739840:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787787383.783918:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2345:x1874630678739840:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 59us (1851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787383.783926:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 81 00000100:00100000:2.0:1787787383.783941:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 82 00000100:00100000:2.0:1787787383.783947:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06025cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2345:x1874630678739968:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787787383.783969:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06025cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2345:x1874630678739968:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 23us (1834us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787383.783975:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 82 00000100:00080000:2.0:1787787383.783995:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787787383.783999:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787787383.784001:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787383.784946:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678739584 00000100:00100000:3.0:1787787383.784955:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678739584 00000100:00100000:3.0:1787787383.785805:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 287 00000100:00100000:3.0:1787787383.785826:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2345:x1874630678739584:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787383.785881:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2345:x1874630678739584:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 58us (3872us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787383.785887:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 287 00000040:00080000:3.0:1787787384.192582:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787787384.192591:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787787384.194158:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787787384.194173:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787787384.446811:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787384.708988:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787384.709066:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678740224 00000100:00100000:3.0:1787787384.709075:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678740224 00000100:00100000:3.0:1787787384.709127:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 139 00000100:00100000:3.0:1787787384.709136:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06025ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+14:11345:x1874630678740224:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787787384.709153:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787384.709172:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b19fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3525b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.709228:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1a01 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.709242:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1a01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.709253:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1a01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.709265:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1a08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.709271:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1a08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.709286:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1a08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.709554:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1a01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.709563:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1a01 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.709569:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1a01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.709574:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708770200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787384.709578:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1a01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.709585:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1a01 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.709596:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:3.0:1787787384.709599:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787384.709603:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1a01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.709610:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1a01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.709620:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1a08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.709625:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1a08 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.709637:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1a08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.709642:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708771800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787384.709645:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1a08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.709652:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1a08 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.709660:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9d071b71d300) 00010000:00010000:3.0:1787787384.709663:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787384.709666:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1a08 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.709671:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1a08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.709700:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b19fa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3525b expref: 15 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.709710:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:3.0:1787787384.709712:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787384.709715:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b19fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3525b expref: 15 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.709724:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708770800, rc 0) 00000100:00100000:3.0:1787787384.709784:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06025ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+14:11345:x1874630678740224:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 649us (804us total) trans 0 rc 301/301 00000100:00100000:3.0:1787787384.709801:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 139 00000100:00100000:0.0:1787787384.714470:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787384.714569:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678740480 00000100:00100000:2.0:1787787384.714577:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678740480 00000100:00100000:2.0:1787787384.714627:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 140 00000100:00100000:2.0:1787787384.714637:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06025ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+14:11345:x1874630678740480:12345-192.168.206.10@tcp:36:lfs.0 00010000:00010000:2.0:1787787384.714689:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787384.714715:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1378 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35094 expref: 14 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787384.714732:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:2.0:1787787384.714737:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787787384.715002:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1a0f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787384.715016:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1cc00/0xdeb1953cba4b19d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3524d expref: 5 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787384.715036:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1a0f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787384.715079:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1cc00/0xdeb1953cba4b19d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3524d expref: 5 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787384.715093:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1cc00/0xdeb1953cba4b19d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3524d expref: 5 pid: 5820 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787384.715107:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737ea4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5821:1874630694475136:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787787384.715195:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073c5ca240 going to sleep for 11 seconds 00000100:00100000:0.0:1787787384.717661:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737ea4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5821:1874630694475136:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787787384.717685:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1a0f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787384.718014:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787384.718075:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678740608 00000100:00100000:2.0:1787787384.718081:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678740608 00010000:00010000:2.0:1787787384.718113:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1cc00/0xdeb1953cba4b19d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3524d expref: 6 pid: 5820 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787384.718150:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 61 00000100:00100000:2.0:1787787384.718159:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06025c8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:267c8212-9bde-4b8e-bca1-0730dc2554b7+6:2345:x1874630678740608:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787384.718174:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787384.718180:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1cc00/0xdeb1953cba4b19d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3524d expref: 6 pid: 5820 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787384.718191:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1cc00/0xdeb1953cba4b19d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3524d expref: 6 pid: 5820 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787384.718211:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1cc00/0xdeb1953cba4b19d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3524d expref: 6 pid: 5820 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787384.718233:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:2.0:1787787384.718238:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1a0f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787384.718247:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1a0f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787384.718255:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1a0f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787384.720368:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787384.720460:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06025c8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2345:x1874630678740608:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 2281us (2425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787384.720471:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 61 00010000:00010000:0.0:1787787384.722380:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1a0f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787384.722409:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1a0f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787384.722434:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd000/0xdeb1953cba4b1a16 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787384.722465:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd000/0xdeb1953cba4b1a16 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787384.722474:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd000/0xdeb1953cba4b1a16 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787384.726688:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787787384.726704:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1a0f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787384.726715:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1a0f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787384.726722:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1a0f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787384.726728:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787384.726732:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1a0f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787384.726739:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1a0f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787384.726755:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:0.0:1787787384.726758:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787384.726763:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1a0f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787384.726769:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1a0f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787787384.727333:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005e131847 reply state 00000000b579afb6 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd000/0xdeb1953cba4b1a16 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787384.727345:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787787384.727469:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06025ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+15:11345:x1874630678740480:12345-192.168.206.10@tcp:36:lfs.0 Request processed in 12830us (13031us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1787787384.727487:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 140 00010000:00010000:0.0:1787787384.729532:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd000/0xdeb1953cba4b1a16 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787384.729546:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd000/0xdeb1953cba4b1a16 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787384.729554:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd000/0xdeb1953cba4b1a16 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787384.729561:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fd000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787384.729565:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd000/0xdeb1953cba4b1a16 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787384.729573:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd000/0xdeb1953cba4b1a16 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787384.729588:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9d07096a0400) 00010000:00010000:0.0:1787787384.729591:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787384.729596:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd000/0xdeb1953cba4b1a16 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787384.729602:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd000/0xdeb1953cba4b1a16 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787384.802158:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787384.802233:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678740736 00000100:00100000:3.0:1787787384.802241:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678740736 00000100:00100000:3.0:1787787384.802291:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 141 00000100:00100000:3.0:1787787384.802300:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737ea4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+14:11353:x1874630678740736:12345-192.168.206.10@tcp:101:lctl.0 00010000:00010000:3.0:1787787384.802321:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787384.802340:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1a1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35262 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.802392:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1a24 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.802418:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1a24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.802431:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1a24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787384.802517:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787787384.802521:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787787384.802539:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1a24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.802559:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1a1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35262 expref: 16 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.802575:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1a24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35262 expref: 15 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.802600:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d071b71d300) 00010000:00010000:3.0:1787787384.802603:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787787384.802606:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708771800, rc 0) 00000100:00100000:3.0:1787787384.802705:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737ea4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+15:11353:x1874630678740736:12345-192.168.206.10@tcp:101:lctl.0 Request processed in 406us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787384.802713:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 141 00000100:00100000:0.0:1787787384.852292:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787384.852387:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678740864 00000100:00100000:3.0:1787787384.852406:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678740864 00000100:00100000:3.0:1787787384.852484:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 142 00000100:00100000:3.0:1787787384.852494:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06025c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+15:11359:x1874630678740864:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:3.0:1787787384.852513:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787384.852531:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1a2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35269 expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.852588:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1a32 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.852601:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1a32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.852611:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1a32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.852625:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1a39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.852632:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1a39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.852667:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1a39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.852766:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030200/0xdeb1953cba4b1a40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.852774:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030200/0xdeb1953cba4b1a40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.852781:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030200/0xdeb1953cba4b1a40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787384.852809:0:9687:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787787384.852812:0:9687:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787787384.852834:0:9687:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030200/0xdeb1953cba4b1a40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.852845:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1a32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.852851:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1a32 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.852859:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1a32 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.852864:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708770200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787384.852868:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1a32 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.852875:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1a32 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.852904:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d071b71d300) 00010000:00010000:3.0:1787787384.852907:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787384.852912:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1a32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.852918:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1a32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.852930:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1a39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.852935:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1a39 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.852940:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1a39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.852944:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708770600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787384.852947:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1a39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.852952:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1a39 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.852958:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9d071b71dc00) 00010000:00010000:3.0:1787787384.852960:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787384.852962:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1a39 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.852968:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1a39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.853006:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1a2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35269 expref: 17 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.853019:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030200/0xdeb1953cba4b1a40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35269 expref: 16 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.853026:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:3.0:1787787384.853028:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787787384.853030:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0700030200, rc 0) 00000100:00100000:3.0:1787787384.853200:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06025c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+16:11359:x1874630678740864:12345-192.168.206.10@tcp:101:bash.0 Request processed in 706us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787384.853208:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 142 00000100:00100000:2.0:1787787384.861974:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787384.862055:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678741120 00000100:00100000:3.0:1787787384.862064:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678741120 00000100:00100000:3.0:1787787384.862120:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 143 00000100:00100000:3.0:1787787384.862129:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737ea6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+16:11359:x1874630678741120:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:3.0:1787787384.862148:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787384.862166:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1a47 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35270 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.862285:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1a4e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.862299:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1a4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.862311:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1a4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.862361:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1a55 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.862370:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1a55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.862377:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1a55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787787384.862918:0:5820:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1787787384.863065:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1a5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.863075:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1a5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.863083:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1a5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.863113:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1a4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.863120:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1a4e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.863127:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1a4e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.863133:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0700030e00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787384.863136:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1a4e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.863155:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1a4e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.863166:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:3.0:1787787384.863169:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787384.863173:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1a4e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.863179:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1a4e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787787384.863191:0:5820:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca7a6b92 reply state 0000000005e583a2 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1a55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787384.863199:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787787384.863225:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1a47 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35270 expref: 19 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.863239:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1a5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35270 expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.863246:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d071b71df00) 00010000:00010000:3.0:1787787384.863248:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787787384.863250:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0700030800, rc 0) 00000100:00100000:3.0:1787787384.863323:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737ea6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+19:11359:x1874630678741120:12345-192.168.206.10@tcp:101:bash.0 Request processed in 1195us (1358us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1787787384.863331:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 143 00000100:00100000:2.0:1787787384.868773:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00010000:00010000:0.0:1787787384.869093:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1a55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787384.869105:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678741248 00010000:00010000:0.0:1787787384.869107:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1a55 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787384.869127:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678741248 00010000:00010000:0.0:1787787384.869141:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1a55 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787384.869150:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0700031c00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787384.869155:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1a55 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787384.869165:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1a55 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787384.869181:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d071b71dc00) 00000100:00100000:3.0:1787787384.869185:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 48 00010000:00010000:0.0:1787787384.869187:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787384.869192:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1a55 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787384.869201:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737ea4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2344:x1874630678741248:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:0.0:1787787384.869202:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1a55 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.869227:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787384.869246:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffe311cf/0xdeb1953cba4b1a6a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35277 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787787384.869270:0:6675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787787384.869289:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=297s v=(0 0) 00010000:00010000:3.0:1787787384.869293:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787384.869302:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffe311cf/0xdeb1953cba4b1a6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35277 expref: 6 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.869318:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ffe311cf/0xdeb1953cba4b1a6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35277 expref: 6 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787384.869330:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708770800, rc 0) 00000100:00100000:3.0:1787787384.869388:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737ea4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2344:x1874630678741248:12345-192.168.206.10@tcp:101:bash.0 Request processed in 192us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787384.869406:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 48 00000100:00100000:1.0:1787787384.873808:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787384.873900:0:10776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678741376 00000100:00100000:2.0:1787787384.873909:0:10776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678741376 00000100:00100000:2.0:1787787384.873967:0:10776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 49 00000100:00100000:2.0:1787787384.873977:0:10776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070303e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+6:11359:x1874630678741376:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:2.0:1787787384.873993:0:10776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787384.874008:0:10776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030798ded/0xdeb1953cba4b1a71 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3527e expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787384.874037:0:10776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ffe311cf/0xdeb1953cba4b1a6a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35277 expref: 7 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787384.874252:0:10776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787384.874256:0:10776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787384.874262:0:10776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030798ded/0xdeb1953cba4b1a71 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3527e expref: 7 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787384.874294:0:10776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ffe311cf/0xdeb1953cba4b1a6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35277 expref: 7 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787384.874308:0:10776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ffe311cf/0xdeb1953cba4b1a6a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35277 expref: 7 pid: 6675 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787384.874322:0:10776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737ea4b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10776:1874630694475264:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787787384.874495:0:10776:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073c5ca3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787384.878288:0:10776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737ea4b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10776:1874630694475264:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787787384.878324:0:10776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000030798ded/0xdeb1953cba4b1a71 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3527e expref: 7 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787384.878343:0:10776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd39800, rc 0) 00000100:00100000:2.0:1787787384.878408:0:10776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070303e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+7:11359:x1874630678741376:12345-192.168.206.10@tcp:101:bash.0 Request processed in 4432us (4609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787384.878418:0:10776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 49 00000100:00100000:2.0:1787787384.879329:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787384.879403:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678741504 00000100:00100000:0.0:1787787384.879410:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678741504 00010000:00010000:0.0:1787787384.879476:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ffe311cf/0xdeb1953cba4b1a6a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35277 expref: 7 pid: 6675 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787384.879504:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 62 00000100:00100000:0.0:1787787384.879513:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737ea4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2344:x1874630678741504:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787384.879526:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787384.879547:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ffe311cf/0xdeb1953cba4b1a6a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35277 expref: 7 pid: 6675 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787384.879577:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ffe311cf/0xdeb1953cba4b1a6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35277 expref: 7 pid: 6675 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787384.879598:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffe311cf/0xdeb1953cba4b1a6a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35277 expref: 7 pid: 6675 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787384.879613:0:5805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787384.879617:0:5805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787384.879625:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000030798ded/0xdeb1953cba4b1a71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3527e expref: 6 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787384.879635:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030798ded/0xdeb1953cba4b1a71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3527e expref: 6 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787384.879666:0:5805:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000030798ded/0xdeb1953cba4b1a71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3527e expref: 6 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787384.879680:0:5805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06025c9680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5805:1874630694475392:192.168.206.10@tcp:105: 00000100:00100000:0.0:1787787384.879746:0:5805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070929a300 going to sleep for 11 seconds 00000100:00100000:0.0:1787787384.885253:0:5805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06025c9680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5805:1874630694475392:192.168.206.10@tcp:105: 00010000:00010000:0.0:1787787384.885280:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787384.885326:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737ea4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2344:x1874630678741504:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 5814us (5999us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787384.885336:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 62 00000100:00100000:1.0:1787787384.885523:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787384.885688:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678741760 00000100:00100000:0.0:1787787384.885695:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678741760 00000100:00100000:0.0:1787787384.885750:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 36 00000100:00100000:0.0:1787787384.885759:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070303d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+18:11359:x1874630678741760:12345-192.168.206.10@tcp:35:bash.0 00000100:00100000:0.0:1787787384.886086:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070303d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+19:11359:x1874630678741760:12345-192.168.206.10@tcp:35:bash.0 Request processed in 327us (564us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1787787384.886095:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 36 00000100:00100000:2.0:1787787384.968593:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787384.968697:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678742016 00000100:00100000:3.0:1787787384.968706:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678742016 00000100:00100000:3.0:1787787384.968766:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 144 00000100:00100000:3.0:1787787384.968776:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737ea5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+19:11369:x1874630678742016:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787787384.968798:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787384.969264:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1a78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35285 expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787384.969392:0:9687:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787787384.970659:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1a78 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35285 expref: 21 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787384.970687:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d071b71d300) 00010000:00010000:2.0:1787787384.970690:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787787384.970696:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1a78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35285 expref: 21 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787384.970712:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708770600, rc 0) 00000100:00100000:2.0:1787787384.970784:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737ea5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+20:11369:x1874630678742016:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 2010us (2203us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1787787384.970793:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 144 00000100:00100000:3.0:1787787384.977304:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787384.980271:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678742272 00000100:00100000:0.0:1787787384.980285:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678742272 00000100:00100000:0.0:1787787384.980421:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 37 00000100:00100000:0.0:1787787384.980432:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+20:11369:x1874630678742272:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:0.0:1787787384.980720:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+21:11369:x1874630678742272:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 290us (3424us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1787787384.980729:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 37 00000100:00100000:1.0:1787787385.057033:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787385.057178:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678742400 00000100:00100000:3.0:1787787385.057187:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678742400 00000100:00100000:3.0:1787787385.057272:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 145 00000100:00100000:3.0:1787787385.057284:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070303f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+21:11375:x1874630678742400:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787787385.057307:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787385.057326:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1a86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3528c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.057389:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1a8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.057415:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1a8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.057428:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1a8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787385.057519:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787787385.057524:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787787385.057546:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1a8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.057572:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1a86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3528c expref: 23 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.057591:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1a8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3528c expref: 22 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.057613:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:3.0:1787787385.057616:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787787385.057620:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708770600, rc 0) 00000100:00100000:3.0:1787787385.057684:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070303f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+22:11375:x1874630678742400:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 403us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787385.057692:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 145 00000100:00080000:2.0:1787787385.058202:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787385.063368:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787385.063476:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678742656 00000100:00100000:0.0:1787787385.063485:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678742656 00000100:00100000:0.0:1787787385.063549:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 146 00000100:00100000:0.0:1787787385.063559:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+22:11375:x1874630678742656:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787787385.063578:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787385.063597:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc800/0xdeb1953cba4b1a94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35293 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.063689:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fda00/0xdeb1953cba4b1a9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.063892:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fda00/0xdeb1953cba4b1a9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.063920:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fda00/0xdeb1953cba4b1a9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787385.063933:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787787385.064072:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc800/0xdeb1953cba4b1a94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35293 expref: 25 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.064095:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fda00/0xdeb1953cba4b1a9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35293 expref: 24 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.064103:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d071b71df00) 00010000:00010000:0.0:1787787385.064107:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787787385.064110:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d07059fda00, rc 0) 00000100:00100000:0.0:1787787385.064171:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+24:11375:x1874630678742656:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 614us (811us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1787787385.064179:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 146 00000100:00100000:0.0:1787787385.067422:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787385.067551:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787385.067556:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678742912 00000100:00100000:1.0:1787787385.067566:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678742912 00000100:00100000:1.0:1787787385.067629:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 147 00000100:00100000:1.0:1787787385.067639:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06025c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+24:11375:x1874630678742912:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787787385.067665:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787385.067684:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b1aa9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3529a expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.067770:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1ab0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.067783:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1ab0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.067805:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1ab0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787385.067818:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787787385.067939:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b1aa9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3529a expref: 27 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.067966:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1ab0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3529a expref: 26 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.067991:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d071b71df00) 00010000:00010000:1.0:1787787385.067994:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787787385.067997:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1de00, rc 0) 00000100:00100000:3.0:1787787385.068060:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678743040 00000100:00100000:3.0:1787787385.068067:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678743040 00000100:00100000:1.0:1787787385.068072:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06025c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+26:11375:x1874630678742912:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 432us (658us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1787787385.068082:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 147 00000100:00100000:3.0:1787787385.068305:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:3.0:1787787385.068315:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06025c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+26:2343:x1874630678743040:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787385.068486:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787385.068506:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fda00/0xdeb1953cba4b1a9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35293 expref: 26 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.068524:0:8496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d071b71df00) 00010000:00010000:3.0:1787787385.068529:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787385.068561:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06025c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+25:2343:x1874630678743040:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 248us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787385.068570:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:0.0:1787787385.084004:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787385.084102:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678743168 00000100:00100000:3.0:1787787385.084111:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678743168 00000100:00080000:2.0:1787787385.084182:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787787385.084187:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 50 00000100:00100000:3.0:1787787385.084199:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06025cad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2344:x1874630678743168:12345-192.168.206.10@tcp:1:lfs.0 00010000:00010000:3.0:1787787385.084240:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009036b26b/0xdeb1953cba4b1abe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.084271:0:6675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000030798ded/0xdeb1953cba4b1a71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3527e expref: 6 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.084280:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787385.084284:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787787385.084289:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009036b26b/0xdeb1953cba4b1abe lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.084321:0:6675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000030798ded/0xdeb1953cba4b1a71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3527e expref: 6 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.084336:0:6675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000030798ded/0xdeb1953cba4b1a71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3527e expref: 6 pid: 10776 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787385.084350:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073c76c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6675:1874630694475520:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787787385.084491:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0706603180 going to sleep for 11 seconds 00000100:00100000:3.0:1787787385.089661:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073c76c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6675:1874630694475520:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787787385.089760:0:6675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009036b26b/0xdeb1953cba4b1abe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787385.090198:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787385.090370:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678743296 00000100:00100000:2.0:1787787385.090378:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678743296 00002000:00100000:2.0:1787787385.090433:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9d06025ca1c0 x1874630678743296/t0(0) o4->c5599457-aa74-4a71-951f-faabe33e6ec7@192.168.206.10@tcp:246/0 lens 504/0 e 0 to 0 dl 1787787396 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787787385.090472:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d06025ca1c0 with x1874630678743296 ext(0->12) 00010000:00010000:2.0:1787787385.090480:0:6678:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000030798ded/0xdeb1953cba4b1a71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3527e expref: 7 pid: 10776 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.090495:0:6678:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000030798ded/0xdeb1953cba4b1a71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3527e expref: 7 pid: 10776 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787787385.090503:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d06025ca1c0 00000100:00100000:2.0:1787787385.090535:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:2.0:1787787385.090545:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06025ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2345:x1874630678743296:12345-192.168.206.10@tcp:4:lfs.0 00000100:00100000:2.0:1787787385.091043:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06025ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+9:2345:x1874630678743296:12345-192.168.206.10@tcp:4:lfs.0 Request processed in 498us (844us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787787385.091052:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 2 00002000:00100000:2.0:1787787385.091059:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9d06025ca1c0 x1874630678743296/t4294967305(0) o4->c5599457-aa74-4a71-951f-faabe33e6ec7@192.168.206.10@tcp:246/0 lens 504/448 e 0 to 0 dl 1787787396 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787787385.091067:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d06025ca1c0 with x1874630678743296 ext(0->12) 00010000:00010000:2.0:1787787385.091073:0:6678:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000030798ded/0xdeb1953cba4b1a71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3527e expref: 9 pid: 10776 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.091085:0:6678:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000030798ded/0xdeb1953cba4b1a71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3527e expref: 9 pid: 10776 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787787385.091092:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d06025ca1c0 00000100:00100000:1.0:1787787385.095140:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787385.095347:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678743424 00000100:00100000:0.0:1787787385.095356:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678743424 00010000:00010000:0.0:1787787385.095407:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000030798ded/0xdeb1953cba4b1a71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3527e expref: 9 pid: 10776 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787385.095535:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 63 00000100:00100000:2.0:1787787385.095547:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070303c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+9:2344:x1874630678743424:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787385.095562:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787787385.095582:0:5805:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787787385.095585:0:5805:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787787384 00002000:00010000:2.0:1787787385.095587:0:5805:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787787384 00002000:00010000:2.0:1787787385.095589:0:5805:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787787384 00010000:00010000:2.0:1787787385.095595:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000030798ded/0xdeb1953cba4b1a71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3527e expref: 9 pid: 10776 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.095610:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000030798ded/0xdeb1953cba4b1a71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3527e expref: 9 pid: 10776 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.095652:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030798ded/0xdeb1953cba4b1a71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3527e expref: 9 pid: 10776 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.095668:0:5805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787787385.095672:0:5805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787787385.095678:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009036b26b/0xdeb1953cba4b1abe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.095688:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009036b26b/0xdeb1953cba4b1abe lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.095980:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787385.096044:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070303c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+8:2344:x1874630678743424:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 491us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787385.096051:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 63 00010000:00010000:3.0:1787787385.099727:0:6675:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009036b26b/0xdeb1953cba4b1abe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.099754:0:6675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009036b26b/0xdeb1953cba4b1abe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.099913:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009036b26b/0xdeb1953cba4b1abe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.099923:0:6675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009036b26b/0xdeb1953cba4b1abe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.099932:0:6675:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009036b26b/0xdeb1953cba4b1abe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.099939:0:6675:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708770200 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:2.0:1787787385.099955:0:6675:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009036b26b/0xdeb1953cba4b1abe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.099977:0:6675:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009036b26b/0xdeb1953cba4b1abe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.099996:0:6675:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009036b26b/0xdeb1953cba4b1abe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.100009:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009036b26b/0xdeb1953cba4b1abe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787385.100137:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06025cad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2344:x1874630678743168:12345-192.168.206.10@tcp:1:lfs.0 Request processed in 15937us (16137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787385.100153:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 50 00000100:00100000:1.0:1787787385.105466:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787385.105550:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678743680 00000100:00100000:2.0:1787787385.105559:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678743680 00000100:00100000:2.0:1787787385.105605:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 38 00000100:00100000:2.0:1787787385.105613:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703166050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+25:11375:x1874630678743680:12345-192.168.206.10@tcp:35:lfs.0 00000004:00010000:2.0:1787787385.105674:0:5822:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1ab0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3529a expref: 25 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787787385.105932:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1787787385.105978:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1787787385.106537:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1787787385.106594:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1ac5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.106620:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1a5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35270 expref: 29 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.106630:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1ac5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.106664:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1a5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35270 expref: 29 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.106679:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1a5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35270 expref: 29 pid: 5820 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787385.106693:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737ea43c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5822:1874630694475648:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787787385.106777:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073c5ca840 going to sleep for 11 seconds 00000100:00100000:2.0:1787787385.113185:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737ea43c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5822:1874630694475648:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787787385.113216:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1ac5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787385.114120:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787385.114203:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678743808 00000100:00100000:0.0:1787787385.114210:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678743808 00010000:00010000:0.0:1787787385.114254:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1a5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35270 expref: 30 pid: 5820 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787385.114285:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 64 00000100:00100000:0.0:1787787385.114293:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705816450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+30:2344:x1874630678743808:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787385.114307:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787385.114313:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1a5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35270 expref: 30 pid: 5820 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.114326:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1a5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35270 expref: 30 pid: 5820 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.114346:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1a5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35270 expref: 30 pid: 5820 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.114362:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d071b71df00) 00010000:00010000:0.0:1787787385.114367:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1ac5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.114376:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1ac5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.114383:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1ac5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.114420:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787385.114513:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705816450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+29:2344:x1874630678743808:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 220us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787385.114522:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 64 00010000:00010000:2.0:1787787385.114772:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1ac5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.114780:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1ac5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787787385.114897:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1787787385.115079:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1787787385.115179:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737ea43c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5822:1874630694475776:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787787385.115229:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787385.115263:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07346909c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787385.116105:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694475776 00000100:00100000:0.0:1787787385.116113:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694475776 00000100:00100000:0.0:1787787385.116177:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787787385.116186:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737ea6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5822:x1874630694475776:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787787385.116268:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737ea6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5822:x1874630694475776:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 83us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787385.116275:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787787385.116354:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737ea43c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5822:1874630694475776:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787787385.116810:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1787787385.116871:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d070303de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5822:1874630694475904:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787787385.116918:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787385.116944:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0708759180 going to sleep for 11 seconds 00000100:00100000:3.0:1787787385.116994:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694475904 00000100:00100000:3.0:1787787385.117000:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694475904 00000100:00100000:3.0:1787787385.117034:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787787385.117052:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070303cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5822:x1874630694475904:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787787385.117215:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070303cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5822:x1874630694475904:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 165us (298us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787787385.117223:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787787385.117355:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d070303de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5822:1874630694475904:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787787385.117409:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1787787385.117469:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1ac5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.117480:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1ac5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.117487:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1ac5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.117494:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787385.117505:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1ac5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.117513:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1ac5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.117527:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d071b71df00) 00010000:00010000:1.0:1787787385.117530:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787787385.117534:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1ac5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.117541:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1ac5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787787385.117705:0:5822:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787787385.117810:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1787787385.117820:0:5822:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 297344381031ns, next at 298344379078ns, rc = 0 00000001:00080000:1.0:1787787385.117826:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1787787385.117855:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d071b71df00) 00010000:00010000:1.0:1787787385.117858:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787787385.117864:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1ab0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3529a expref: 33 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787787385.117975:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787787385.118971:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703166050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+32:11375:x1874630678743680:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 13355us (13540us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1787787385.118983:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 38 00000020:00080000:1.0:1787787385.118987:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787787385.121582:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787385.121645:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678743936 00000100:00100000:2.0:1787787385.121654:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678743936 00000100:00100000:2.0:1787787385.121710:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 148 00000100:00100000:2.0:1787787385.121720:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070303d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+32:11375:x1874630678743936:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787787385.121741:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787385.121762:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b1acc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c352a1 expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.121823:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b1acc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352a1 expref: 33 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.121837:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b1acc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352a1 expref: 33 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.121855:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07078d0b00) 00010000:00010000:2.0:1787787385.121858:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787787385.121861:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd38400, rc 0) 00000100:00100000:2.0:1787787385.121919:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070303d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+33:11375:x1874630678743936:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 200us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787385.121927:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 148 00000100:00100000:2.0:1787787385.125880:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787385.125955:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678744192 00000100:00100000:0.0:1787787385.125965:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678744192 00000100:00100000:0.0:1787787385.126027:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 39 00000100:00100000:0.0:1787787385.126037:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737ea61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+33:11375:x1874630678744192:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:0.0:1787787385.126299:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737ea61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+34:11375:x1874630678744192:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 262us (425us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1787787385.126307:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 39 00000100:00100000:3.0:1787787385.208982:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787385.209089:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678744448 00000100:00100000:0.0:1787787385.209103:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678744448 00000100:00100000:0.0:1787787385.209178:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 149 00000100:00100000:0.0:1787787385.209189:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073c76c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+34:11385:x1874630678744448:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787787385.209213:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787385.209232:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1ad3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c352a8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787385.209342:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787787385.209509:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1ad3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352a8 expref: 36 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.209523:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d071b71d300) 00010000:00010000:0.0:1787787385.209538:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787787385.209544:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1ad3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352a8 expref: 36 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.209564:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d07059fc000, rc 0) 00000100:00100000:0.0:1787787385.209616:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073c76c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+35:11385:x1874630678744448:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 430us (648us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1787787385.209623:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 149 00000100:00100000:2.0:1787787385.213533:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787385.213820:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678744576 00000100:00100000:0.0:1787787385.213828:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678744576 00000100:00100000:0.0:1787787385.213878:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 150 00000100:00100000:0.0:1787787385.213888:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737ea52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+35:11385:x1874630678744576:12345-192.168.206.10@tcp:34:lfs.0 00010000:00010000:0.0:1787787385.213951:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1ae1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.213968:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1ae1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.213978:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1ae1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.213992:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1ae8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.213998:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.214004:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.214092:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b1aef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.214112:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b1aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.214120:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b1aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787787385.214160:0:9687:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b1aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.214172:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1ae1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.214179:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1ae1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.214185:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1ae1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.214191:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fce00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787385.214195:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1ae1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.214202:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1ae1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.214214:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:0.0:1787787385.214217:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787385.214221:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1ae1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.214227:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1ae1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.214254:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.214260:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1ae8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.214265:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1ae8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.214270:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fd200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787385.214273:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1ae8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.214280:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1ae8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.214288:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d07096a0400) 00010000:00010000:0.0:1787787385.214291:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787385.214294:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1ae8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.214299:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1ae8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.215285:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b1aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.215297:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b1aef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.215303:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b1aef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.215317:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fd600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787385.215320:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b1aef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.215327:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b1aef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.215339:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07078d0b00) 00010000:00010000:0.0:1787787385.215341:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787385.215344:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b1aef lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.215349:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b1aef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787385.215464:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737ea52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+35:11385:x1874630678744576:12345-192.168.206.10@tcp:34:lfs.0 Request processed in 1574us (1938us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787385.215473:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 150 00000100:00100000:0.0:1787787385.217822:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06025c8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694476032:0@lo:400:kworker.0 00000100:00100000:0.0:1787787385.217880:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787385.217919:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06025c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1874630694476544:0@lo:400:kworker.0 00000100:00100000:0.0:1787787385.217943:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787385.217968:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787787385.217975:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06025cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694476416:0@lo:400:kworker.0 00000100:00100000:0.0:1787787385.217998:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787385.218022:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06025c83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874630694476160:0@lo:400:kworker.0 00000100:00100000:0.0:1787787385.218042:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787385.218070:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787787385.218076:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06025c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1874630694476288:0@lo:400:kworker.0 00000100:00100000:0.0:1787787385.218098:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787385.218124:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694476416 00000100:00100000:0.0:1787787385.218131:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694476416 00000100:00100000:0.0:1787787385.218179:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787787385.218191:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06025c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694476416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787385.218236:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06025c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694476416:12345-0@lo:400:kworker.0 Request processed in 49us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787385.218243:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787787385.218275:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06025cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694476416:0@lo:400:kworker.0 00000100:00100000:0.0:1787787385.218298:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694476544 00000100:00100000:0.0:1787787385.218301:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694476544 00000100:00100000:0.0:1787787385.218323:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694476160 00000100:00100000:0.0:1787787385.218325:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694476160 00000100:00100000:0.0:1787787385.218335:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694476288 00000100:00100000:0.0:1787787385.218337:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694476288 00000100:00100000:0.0:1787787385.218349:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787787385.218355:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06025c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1874630694476544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787385.218387:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06025c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1874630694476544:12345-0@lo:400:kworker.0 Request processed in 33us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787385.218403:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787787385.218415:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787787385.218421:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06025cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874630694476160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787385.218473:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06025cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874630694476160:12345-0@lo:400:kworker.0 Request processed in 52us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787385.218479:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787787385.218498:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787787385.218505:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06025c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874630694476288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787385.219073:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06025c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1874630694476544:0@lo:400:kworker.0 00000100:00100000:1.0:1787787385.219112:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06025c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1874630694476288:0@lo:400:kworker.0 00000100:00100000:1.0:1787787385.219133:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06025c83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874630694476160:0@lo:400:kworker.0 00000100:00100000:0.0:1787787385.221120:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06025c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874630694476288:12345-0@lo:400:kworker.0 Request processed in 29us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787385.221135:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787787385.221600:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694476032 00000100:00100000:3.0:1787787385.221609:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694476032 00000100:00100000:3.0:1787787385.221718:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787787385.221728:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3292:x1874630694476032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787385.221834:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3292:x1874630694476032:12345-0@lo:400:kworker.0 Request processed in 109us (3954us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787385.221841:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787787385.221929:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00080000:2.0:1787787385.223727:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787787385.223737:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787385.223784:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678744832 00000100:00100000:2.0:1787787385.223800:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678744832 00000100:00100000:2.0:1787787385.223869:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 40 00000100:00100000:2.0:1787787385.223878:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07185a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+35:11385:x1874630678744832:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:2.0:1787787385.224407:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07185a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+36:11385:x1874630678744832:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 518us (2467us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1787787385.224417:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 40 00000100:00100000:2.0:1787787385.224631:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06025c8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694476032:0@lo:400:kworker.0 00000001:00080000:2.0:1787787385.270361:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967433 is committed 00000004:00080000:2.0:1787787385.270388:0:5842:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1787787385.270423:0:5842:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d07087599c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1787787385.270428:0:5842:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d0737a0a600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d0708759540 00000020:00080000:2.0:1787787385.270431:0:5842:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d0737a0a400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d0706b3d000 00000100:00100000:1.0:1787787385.270633:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787787385.270662:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d070303f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694476672:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787787385.270728:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787385.270901:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694476672 00000100:00100000:1.0:1787787385.270909:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694476672 00000100:00100000:1.0:1787787385.270949:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787787385.270957:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070303da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3294:x1874630694476672:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787787385.270982:0:6674:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:1.0:1787787385.271011:0:6674:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8f7878, atime: 0x6a8f7878, ctime: 0x6a8f7878, blocks: 0x1 00010000:00010000:1.0:1787787385.271019:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000806c55a7/0xdeb1953cba4b1af6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.271034:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=297s v=(0 0) 00010000:00010000:1.0:1787787385.271053:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787385.271060:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000806c55a7/0xdeb1953cba4b1af6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.271073:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000806c55a7/0xdeb1953cba4b1af6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.271084:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000806c55a7/0xdeb1953cba4b1af6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.271092:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000806c55a7/0xdeb1953cba4b1af6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.271125:0:6674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787787385.271635:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070303da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3294:x1874630694476672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 676us (904us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787787385.271712:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:1.0:1787787385.271742:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787385.271749:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000806c55a7/0xdeb1953cba4b1af6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.271759:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1de00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:1.0:1787787385.271764:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000806c55a7/0xdeb1953cba4b1af6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.271773:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000806c55a7/0xdeb1953cba4b1af6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.271856:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000806c55a7/0xdeb1953cba4b1af6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.271865:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000806c55a7/0xdeb1953cba4b1af6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.271882:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787385.271884:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787385.271885:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787787385.271916:0:3294:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d070303f0c0/2, rc 0, transno 4294967307 00000100:00100000:1.0:1787787385.271922:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d070303f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694476672:0@lo:6:osp-syn-1-0.0 00000020:00080000:3.0:1787787385.272063:0:5853:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1787787385.272173:0:5853:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1787787385.273989:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787385.274078:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678745088 00000100:00100000:1.0:1787787385.274087:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678745088 00000100:00100000:1.0:1787787385.274150:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 151 00000100:00100000:1.0:1787787385.274160:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07185a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+17:11388:x1874630678745088:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787787385.274184:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787385.274204:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b1afd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c352af expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.274273:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1b04 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.274287:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1b04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.274296:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1b04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.274309:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d600/0xdeb1953cba4b1b0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.274315:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d600/0xdeb1953cba4b1b0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.274322:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d600/0xdeb1953cba4b1b0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.275022:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1b12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.275035:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1b12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.275055:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1b12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787385.275065:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787787385.275151:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1b04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.275159:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1b04 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.275166:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1b04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.275171:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1dc00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787385.275176:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1b04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.275183:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1b04 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.275194:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:1.0:1787787385.275197:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787385.275202:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1b04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.275208:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1b04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.275217:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d600/0xdeb1953cba4b1b0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.275222:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d600/0xdeb1953cba4b1b0b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.275234:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d600/0xdeb1953cba4b1b0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.275239:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1d600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787385.275242:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d600/0xdeb1953cba4b1b0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.275248:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d600/0xdeb1953cba4b1b0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.275255:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d07114ac900) 00010000:00010000:1.0:1787787385.275258:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787385.275260:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d600/0xdeb1953cba4b1b0b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.275265:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d600/0xdeb1953cba4b1b0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.275305:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b1afd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352af expref: 20 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.275317:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1b12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352af expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.275324:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07078d0b00) 00010000:00010000:1.0:1787787385.275327:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787787385.275329:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1c800, rc 0) 00000100:00100000:1.0:1787787385.275465:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07185a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+19:11388:x1874630678745088:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 1306us (1483us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1787787385.275480:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 151 00000100:00100000:2.0:1787787385.280419:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787385.280572:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678745216 00000100:00100000:3.0:1787787385.280583:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678745216 00000100:00100000:3.0:1787787385.280696:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 152 00000100:00100000:3.0:1787787385.280706:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+19:11388:x1874630678745216:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:3.0:1787787385.280766:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1b20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.280814:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1b20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.280826:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1b20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.280853:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1b20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.280861:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1b20 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.280868:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1b20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.280873:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708770800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787385.280876:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1b20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.280884:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1b20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.280895:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07078d0b00) 00010000:00010000:3.0:1787787385.280898:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787787385.280902:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1b20 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.280908:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1b20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787385.280982:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+19:11388:x1874630678745216:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 277us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787385.280996:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 152 00000100:00100000:3.0:1787787385.284119:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787385.284529:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678745472 00000100:00100000:2.0:1787787385.284538:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678745472 00000100:00100000:2.0:1787787385.284594:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 41 00000100:00100000:2.0:1787787385.284604:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+19:11388:x1874630678745472:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:2.0:1787787385.285015:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+20:11388:x1874630678745472:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 411us (904us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1787787385.285024:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 41 00010000:00010000:2.0:1787787385.469266:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787385.546950:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787385.547117:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678745728 00000100:00100000:1.0:1787787385.547128:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678745728 00000100:00100000:1.0:1787787385.547225:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 153 00000100:00100000:1.0:1787787385.547233:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06025cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+20:11420:x1874630678745728:12345-192.168.206.10@tcp:101:cat.0 00010000:00010000:1.0:1787787385.547252:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787385.547267:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b1b27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c352b6 expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.547346:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d600/0xdeb1953cba4b1b2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.547357:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d600/0xdeb1953cba4b1b2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.547367:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d600/0xdeb1953cba4b1b2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787385.547377:0:9687:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787787385.547549:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b1b27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352b6 expref: 23 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.547568:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d600/0xdeb1953cba4b1b2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352b6 expref: 22 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.547577:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07078d0b00) 00010000:00010000:1.0:1787787385.547579:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787787385.547582:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1d600, rc 0) 00000100:00100000:1.0:1787787385.547731:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06025cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+22:11420:x1874630678745728:12345-192.168.206.10@tcp:101:cat.0 Request processed in 497us (789us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1787787385.547740:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 153 00000100:00100000:0.0:1787787385.552094:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787385.552145:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787385.552252:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678745856 00000100:00100000:3.0:1787787385.552257:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678746112 00000100:00100000:3.0:1787787385.552261:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678746112 00000100:00100000:1.0:1787787385.552261:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678745856 00000100:00100000:1.0:1787787385.552312:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:3.0:1787787385.552316:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 42 00000100:00100000:1.0:1787787385.552321:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06025c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+23:2345:x1874630678745856:12345-192.168.206.10@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787787385.552322:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06025c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+23:11420:x1874630678746112:12345-192.168.206.10@tcp:35:cat.0 00010000:00010000:1.0:1787787385.552337:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787385.552359:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d600/0xdeb1953cba4b1b2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352b6 expref: 23 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787385.552376:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07078d0b00) 00010000:00010000:1.0:1787787385.552380:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787385.552455:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06025c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+22:2345:x1874630678745856:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 119us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787385.552463:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:3.0:1787787385.552563:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06025c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+22:11420:x1874630678746112:12345-192.168.206.10@tcp:35:cat.0 Request processed in 240us (477us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1787787385.552570:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 42 00000100:00100000:3.0:1787787385.627536:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787385.628020:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678746368 00000100:00100000:2.0:1787787385.628030:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678746368 00000100:00100000:2.0:1787787385.628182:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 154 00000100:00100000:2.0:1787787385.628200:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+22:11426:x1874630678746368:12345-192.168.206.10@tcp:101:dd.0 00010000:00010000:2.0:1787787385.628251:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787385.628254:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787787385.628281:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1a8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3528c expref: 22 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.628300:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:2.0:1787787385.628304:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787787385.628318:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1b3c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c352bd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.629609:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1b43 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.629630:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1b12 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352af expref: 22 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.629639:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1b43 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.629680:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1b12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352af expref: 22 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.629695:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1b12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352af expref: 22 pid: 5819 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787385.629709:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737ea43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1874630694476800:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787787385.629791:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07346900c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787385.641924:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787385.642102:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737ea43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1874630694476800:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787787385.642151:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1b43 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787385.642275:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678746496 00000100:00100000:3.0:1787787385.642282:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678746496 00010000:00010000:3.0:1787787385.642317:0:8496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1b12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352af expref: 23 pid: 5819 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787385.642351:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 65 00000100:00100000:3.0:1787787385.642360:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06025c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+23:2345:x1874630678746496:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787385.642378:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787385.642384:0:8496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1b12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352af expref: 23 pid: 5819 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.642409:0:8496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1b12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352af expref: 23 pid: 5819 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.642429:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1b12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352af expref: 23 pid: 5819 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.642484:0:8496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07078d0b00) 00010000:00010000:3.0:1787787385.642489:0:8496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1b43 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.642498:0:8496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1b43 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.642505:0:8496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1b43 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.642533:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787385.642594:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06025c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+22:2345:x1874630678746496:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 234us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787385.642601:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 65 00010000:00010000:2.0:1787787385.642661:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1b43 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.642668:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1b43 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787385.642685:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787787385.642834:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1b3c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352bd expref: 23 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.642850:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1b43 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352bd expref: 22 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.642858:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07078d0b00) 00010000:00010000:2.0:1787787385.642861:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787787385.642864:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd39800, rc 0) 00000100:00100000:2.0:1787787385.642889:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+22:11426:x1874630678746368:12345-192.168.206.10@tcp:101:dd.0 Request processed in 14700us (15363us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1787787385.642896:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 154 00000100:00100000:0.0:1787787385.650274:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787385.650564:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678746752 00000100:00100000:2.0:1787787385.650650:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678746752 00000100:00100000:2.0:1787787385.650706:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 155 00000100:00100000:2.0:1787787385.650716:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06025c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+22:11426:x1874630678746752:12345-192.168.206.10@tcp:36:dd.0 00010000:00010000:2.0:1787787385.650964:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1b51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.651004:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1b51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.651015:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1b51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787787385.651065:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1787787385.651090:0:5819:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000026bfd68f reply state 00000000801f309f transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1b51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787385.651098:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787787385.651219:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06025c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+25:11426:x1874630678746752:12345-192.168.206.10@tcp:36:dd.0 Request processed in 504us (951us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1787787385.651226:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 155 00000020:00080000:2.0:1787787385.651231:0:5819:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787787385.659250:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1b51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.659268:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1b51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.659276:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1b51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.659283:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd38800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787385.659288:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1b51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.659295:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1b51 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.659312:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07078d0b00) 00010000:00010000:0.0:1787787385.659316:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787385.659320:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1b51 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.659344:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1b51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787385.726330:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787787385.726354:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06025cb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694476928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787787385.726435:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787385.726566:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694476928 00000100:00100000:0.0:1787787385.726574:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694476928 00000100:00100000:0.0:1787787385.726635:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787787385.726644:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737ea43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1874630694476928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787787385.726686:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787787385.726730:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737ea43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1874630694476928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787385.726737:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787787385.726872:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06025cb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694476928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787385.877551:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787385.877854:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678746880 00000100:00100000:3.0:1787787385.877864:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678746880 00000100:00100000:3.0:1787787385.877924:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 156 00000100:00100000:3.0:1787787385.877934:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06025cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+24:11440:x1874630678746880:12345-192.168.206.10@tcp:101:stat.0 00010000:00010000:3.0:1787787385.877958:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787385.878544:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1b58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c352c4 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.878613:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1b5f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.878627:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1b5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.878650:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1b5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.878793:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1b66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.878803:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1b66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.878811:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1b66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.879331:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1b6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.879345:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1b43 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352bd expref: 25 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.879354:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1b6d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.879385:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1b43 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352bd expref: 25 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.879417:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1b43 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352bd expref: 25 pid: 5820 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787385.879431:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06032ef0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5821:1874630694477056:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787787385.879625:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0706603180 going to sleep for 11 seconds 00000100:00100000:3.0:1787787385.885286:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06032ef0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5821:1874630694477056:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787787385.885315:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1b6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787385.885622:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787385.885694:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678747136 00000100:00100000:2.0:1787787385.885700:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678747136 00000100:00100000:2.0:1787787385.885754:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 43 00000100:00100000:2.0:1787787385.885762:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+26:5580:x1874630678747136:12345-192.168.206.10@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787787385.886028:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+27:5580:x1874630678747136:12345-192.168.206.10@tcp:35:ldlm_bl.0 Request processed in 266us (407us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1787787385.886036:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 43 00000100:00100000:1.0:1787787385.889234:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787385.889357:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678747264 00000100:00100000:0.0:1787787385.889431:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678747264 00010000:00010000:2.0:1787787385.889693:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1b43 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352bd expref: 27 pid: 5820 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787385.889780:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 66 00000100:00100000:2.0:1787787385.889790:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070303fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+27:2345:x1874630678747264:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787385.889826:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787385.889834:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1b43 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352bd expref: 27 pid: 5820 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.889847:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1b43 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352bd expref: 27 pid: 5820 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.889869:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1b43 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352bd expref: 27 pid: 5820 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.889886:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07078d0b00) 00010000:00010000:2.0:1787787385.889891:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1b6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.889900:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1b6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.889907:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1b6d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.889938:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787385.889997:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070303fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+26:2345:x1874630678747264:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 209us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787385.890005:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 66 00010000:00010000:3.0:1787787385.890563:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1b6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.890574:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1b6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787385.890616:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787787385.890621:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787787385.890639:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1b6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.890652:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1b6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.890662:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1b5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.890668:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1b5f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.890675:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1b5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.890681:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708770600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787385.890685:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1b5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.890692:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1b5f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.890703:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:3.0:1787787385.890715:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787385.890720:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1b5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.890726:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1b5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.890740:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1b66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.890746:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1b66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.890752:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1b66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.890757:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708770200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787385.890760:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1b66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.890766:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1b66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.890774:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d071b71d200) 00010000:00010000:3.0:1787787385.890777:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787385.890779:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1b66 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.890785:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1b66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.890818:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1b58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352c4 expref: 26 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.890842:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1b6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352c4 expref: 25 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787385.890849:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07078d0b00) 00010000:00010000:3.0:1787787385.890852:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787787385.890856:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0700030800, rc 0) 00000100:00100000:3.0:1787787385.890904:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06025cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+25:11440:x1874630678746880:12345-192.168.206.10@tcp:101:stat.0 Request processed in 12972us (13361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787385.890912:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 156 00000100:00100000:1.0:1787787385.990993:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787385.991137:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678747520 00000100:00100000:0.0:1787787385.991146:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678747520 00000100:00100000:0.0:1787787385.991332:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 157 00000100:00100000:0.0:1787787385.991343:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070303f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+25:11446:x1874630678747520:12345-192.168.206.10@tcp:36:truncate.0 00010000:00010000:0.0:1787787385.991415:0:9687:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787385.991467:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1b6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352c4 expref: 25 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.991486:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07078d0b00) 00010000:00010000:0.0:1787787385.991491:0:9687:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787787385.991687:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1b74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.991715:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1b74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787385.991723:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1b74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787787385.991772:0:9687:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1787787385.991796:0:9687:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e47bc137 reply state 0000000055a94b27 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1b74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787385.991804:0:9687:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787787385.991907:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070303f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+27:11446:x1874630678747520:12345-192.168.206.10@tcp:36:truncate.0 Request processed in 566us (923us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1787787385.991915:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 157 00000020:00080000:0.0:1787787385.991919:0:9687:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787787385.996296:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1b74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.996327:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1b74 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.996334:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1b74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.996340:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fcc00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787385.996345:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1b74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.996353:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1b74 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.996370:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07078d0b00) 00010000:00010000:2.0:1787787385.996373:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787385.996376:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1b74 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787385.996382:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1b74 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787386.159879:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787386.160023:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678747648 00000100:00100000:2.0:1787787386.160032:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678747648 00000100:00100000:2.0:1787787386.160091:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 158 00000100:00100000:2.0:1787787386.160101:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070303e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+26:11460:x1874630678747648:12345-192.168.206.10@tcp:101:stat.0 00010000:00010000:2.0:1787787386.160124:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787386.160143:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1b7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c352cb expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.160207:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1b82 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.160234:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1b82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.160245:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1b82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.160259:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1b89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.160266:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1b89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.160272:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1b89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.160652:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1b90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.160662:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1b90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.160670:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1b90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787386.160703:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1787787386.160707:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787787386.160723:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1b90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.160734:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1b90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.160752:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1b82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.160759:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1b82 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.160765:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1b82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.160770:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787386.160774:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1b82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.160781:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1b82 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.160793:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:2.0:1787787386.160796:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787386.160800:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1b82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.160807:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1b82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.160819:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1b89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.160825:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1b89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.160830:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1b89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.160842:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787386.160845:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1b89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.160851:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1b89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.160860:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d07078d0e00) 00010000:00010000:2.0:1787787386.160863:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787386.160865:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1b89 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.160871:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1b89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.160900:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1b7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352cb expref: 28 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.160913:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1b90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352cb expref: 27 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.160919:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07078d0b00) 00010000:00010000:2.0:1787787386.160922:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787787386.160924:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd38a00, rc 0) 00000100:00100000:2.0:1787787386.160984:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070303e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+27:11460:x1874630678747648:12345-192.168.206.10@tcp:101:stat.0 Request processed in 885us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787386.160992:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 158 00000100:00100000:0.0:1787787386.272155:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787386.273969:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678747904 00000100:00100000:2.0:1787787386.273994:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678747904 00000100:00100000:2.0:1787787386.274106:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 159 00000100:00100000:2.0:1787787386.274116:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707091e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+27:11470:x1874630678747904:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787787386.274135:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787386.274155:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1b97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c352d2 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787386.274379:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787787386.274584:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1b97 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352d2 expref: 29 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.274599:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d071b71d300) 00010000:00010000:2.0:1787787386.274602:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787787386.274607:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1b97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352d2 expref: 29 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.274620:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd39800, rc 0) 00000100:00100000:2.0:1787787386.274688:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707091e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+28:11470:x1874630678747904:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 573us (2542us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1787787386.274696:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 159 00000100:00100000:1.0:1787787386.289488:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787386.290723:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678748160 00000100:00100000:2.0:1787787386.290736:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678748160 00000100:00100000:2.0:1787787386.291015:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 44 00000100:00100000:2.0:1787787386.291037:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703164c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+28:11470:x1874630678748160:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:2.0:1787787386.291498:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703164c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+29:11470:x1874630678748160:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 471us (2015us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1787787386.291507:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 44 00000100:00100000:1.0:1787787386.352647:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787386.352719:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678748416 00000100:00100000:2.0:1787787386.352740:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678748416 00000100:00100000:2.0:1787787386.352796:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 160 00000100:00100000:2.0:1787787386.352806:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070303e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+29:11476:x1874630678748416:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:2.0:1787787386.352829:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787386.352847:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1ba5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c352d9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.353116:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1bac lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.353131:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1b90 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352cb expref: 30 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.353139:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1bac lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.353170:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1b90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352cb expref: 30 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.353183:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1b90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352cb expref: 30 pid: 5820 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787386.353422:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737ea61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1874630694477184:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787787386.353540:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07346900c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787386.356625:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787386.356833:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678748544 00000100:00100000:3.0:1787787386.356843:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678748544 00010000:00010000:3.0:1787787386.356879:0:8496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1b90 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352cb expref: 31 pid: 5820 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787386.356924:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 67 00000100:00100000:3.0:1787787386.356933:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe00780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+31:2345:x1874630678748544:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787386.356948:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787386.356954:0:8496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1b90 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352cb expref: 31 pid: 5820 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787386.356967:0:8496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1b90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352cb expref: 31 pid: 5820 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787386.356995:0:8496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07078d0b00) 00010000:00010000:3.0:1787787386.356999:0:8496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1bac lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.357006:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38a00/0xdeb1953cba4b1b90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352cb expref: 31 pid: 5820 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787386.357022:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737ea61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1874630694477184:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787787386.357026:0:8496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1bac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787386.357034:0:8496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1bac lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787386.357048:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787787386.357050:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1bac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.357057:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1bac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.357062:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1bac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787386.357078:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000100:00100000:3.0:1787787386.357102:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe00780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+30:2345:x1874630678748544:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 170us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787386.357109:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 67 00010000:00010000:2.0:1787787386.357216:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1ba5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352d9 expref: 31 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.357230:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1bac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352d9 expref: 30 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.357238:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07078d0b00) 00010000:00010000:2.0:1787787386.357240:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787787386.357242:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd39200, rc 0) 00000100:00100000:2.0:1787787386.357267:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070303e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+30:11476:x1874630678748416:12345-192.168.206.10@tcp:101:bash.0 Request processed in 4463us (4642us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1787787386.357274:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 160 00000100:00100000:1.0:1787787386.360095:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787386.361012:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678748800 00000100:00100000:0.0:1787787386.361021:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678748800 00000100:00100000:0.0:1787787386.361079:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 161 00000100:00100000:0.0:1787787386.361089:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070303c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+30:11476:x1874630678748800:12345-192.168.206.10@tcp:36:bash.0 00010000:00010000:0.0:1787787386.361339:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1bba lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.361356:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1bba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.361366:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1bba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787787386.361455:0:9687:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1787787386.361484:0:9687:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000087d018 reply state 00000000f51d5fc5 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1bba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787386.361494:0:9687:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787787386.361585:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070303c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+33:11476:x1874630678748800:12345-192.168.206.10@tcp:36:bash.0 Request processed in 497us (1497us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1787787386.361593:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 161 00000020:00080000:0.0:1787787386.361599:0:9687:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787787386.364062:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1bba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.364079:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1bba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.364087:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1bba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.364093:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fc400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787386.364097:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1bba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.364106:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1bba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.364121:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07078d0b00) 00010000:00010000:0.0:1787787386.364124:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787386.364129:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1bba lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.364135:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1bba lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787386.369245:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787386.369357:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678748928 00000100:00100000:3.0:1787787386.369504:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678748928 00000100:00100000:3.0:1787787386.369611:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 162 00000100:00100000:3.0:1787787386.369622:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070303ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+32:11476:x1874630678748928:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:3.0:1787787386.369645:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787386.369664:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1bc1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c352e0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787386.369757:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1bc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787386.369772:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1bac lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352d9 expref: 33 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787386.369780:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1bc8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787386.369819:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1bac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352d9 expref: 33 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787386.369858:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1bac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352d9 expref: 33 pid: 5820 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787386.369879:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06032ef0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5821:1874630694477312:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787787386.369964:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0706603180 going to sleep for 11 seconds 00000100:00100000:1.0:1787787386.375821:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787386.376891:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678749056 00000100:00100000:0.0:1787787386.376901:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678749056 00010000:00010000:0.0:1787787386.376941:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1bac lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352d9 expref: 34 pid: 5820 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787386.376984:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 68 00000100:00100000:0.0:1787787386.376994:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070303cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+34:2344:x1874630678749056:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787386.377009:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787386.377016:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1bac lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352d9 expref: 34 pid: 5820 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.377029:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1bac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352d9 expref: 34 pid: 5820 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.377050:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07078d0b00) 00010000:00010000:0.0:1787787386.377056:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1bc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.377066:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.377073:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1bc8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.377097:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787386.377156:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070303cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+34:2344:x1874630678749056:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 163us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787386.377164:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 68 00010000:00010000:3.0:1787787386.377315:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1bac lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352d9 expref: 33 pid: 5820 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787386.377336:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06032ef0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5821:1874630694477312:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787787386.377359:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787386.377369:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787386.377374:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787386.377431:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787787386.377435:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787787386.377499:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787386.377585:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1bc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352e0 expref: 33 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787386.377617:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1bc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352e0 expref: 32 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787386.377632:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07078d0b00) 00010000:00010000:3.0:1787787386.377635:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787787386.377638:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0700031a00, rc 0) 00000100:00100000:3.0:1787787386.377669:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070303ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+32:11476:x1874630678748928:12345-192.168.206.10@tcp:101:bash.0 Request processed in 8049us (8434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787386.377681:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 162 00000100:00100000:1.0:1787787386.385141:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787386.388735:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678749312 00000100:00100000:3.0:1787787386.388750:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678749312 00000100:00100000:3.0:1787787386.388882:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 45 00000100:00100000:3.0:1787787386.388895:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+32:11476:x1874630678749312:12345-192.168.206.10@tcp:35:bash.0 00000100:00100000:3.0:1787787386.389134:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+33:11476:x1874630678749312:12345-192.168.206.10@tcp:35:bash.0 Request processed in 242us (4755us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1787787386.389142:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 45 00000100:00100000:0.0:1787787386.459324:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787386.459432:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678749568 00000100:00100000:2.0:1787787386.459466:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678749568 00000100:00100000:2.0:1787787386.459598:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 163 00000100:00100000:2.0:1787787386.459608:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0601f97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+33:11486:x1874630678749568:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787787386.459631:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787386.459650:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1bcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c352e7 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787386.460114:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787787386.460289:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1bcf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352e7 expref: 35 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.460303:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d071b71d300) 00010000:00010000:2.0:1787787386.460306:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787787386.460311:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1bcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352e7 expref: 35 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.460327:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd39800, rc 0) 00000100:00100000:2.0:1787787386.460548:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0601f97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+34:11486:x1874630678749568:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 940us (1232us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1787787386.460556:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 163 00000100:00100000:1.0:1787787386.467713:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787386.467952:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678749696 00000100:00100000:0.0:1787787386.467961:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678749696 00000100:00100000:0.0:1787787386.468022:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 164 00000100:00100000:0.0:1787787386.468042:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+34:11486:x1874630678749696:12345-192.168.206.10@tcp:34:lfs.0 00010000:00010000:0.0:1787787386.468113:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1bdd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.468130:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1bdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.468140:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1bdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.468154:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1be4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.468161:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1be4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.468167:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1be4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.468656:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1beb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.468667:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1beb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.468675:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1beb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787787386.468725:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1beb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.468738:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1bdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.468744:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1bdd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.468750:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1bdd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.468756:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fc600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787386.468759:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1bdd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.468766:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1bdd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.468777:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:0.0:1787787386.468780:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787386.468784:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1bdd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.468789:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1bdd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.468818:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1be4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.468824:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1be4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.468836:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1be4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.468841:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fc200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787386.468844:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1be4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.468852:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1be4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.468862:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d07096a0100) 00010000:00010000:0.0:1787787386.468865:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787386.468868:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1be4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.468874:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1be4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.468890:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1beb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.468897:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1beb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.468909:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1beb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.468914:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fdc00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787386.468916:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1beb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.468932:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1beb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.468939:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07078d0b00) 00010000:00010000:0.0:1787787386.468941:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787386.468944:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1beb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.468949:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1beb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787386.469166:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+34:11486:x1874630678749696:12345-192.168.206.10@tcp:34:lfs.0 Request processed in 996us (1330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787386.469176:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 164 00000100:00100000:1.0:1787787386.472397:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787386.472740:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678749952 00000100:00100000:2.0:1787787386.472750:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678749952 00000100:00100000:2.0:1787787386.472863:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 46 00000100:00100000:2.0:1787787386.472874:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+34:11486:x1874630678749952:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:2.0:1787787386.474575:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+35:11486:x1874630678749952:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 1695us (2187us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1787787386.474588:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 46 00010000:00010000:3.0:1787787386.493953:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787386.522222:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787386.522331:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678750208 00000100:00100000:0.0:1787787386.522341:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678750208 00000100:00100000:0.0:1787787386.522410:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 165 00000100:00100000:0.0:1787787386.522420:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+35:11489:x1874630678750208:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787787386.522484:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787386.522504:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1bf2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c352ee expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.522593:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1bf9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.522608:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1bf9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.522620:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1bf9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.522648:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1c00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.522657:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1c00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.522663:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1c00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.523018:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1c07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.523028:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1c07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.523036:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1c07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787386.523046:0:9687:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787787386.523126:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1bf9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.523134:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1bf9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.523140:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1bf9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.523146:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fc200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787386.523150:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1bf9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.523168:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1bf9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.523180:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:0.0:1787787386.523182:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787386.523187:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1bf9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.523193:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1bf9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.523210:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1c00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.523215:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1c00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.523220:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1c00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.523225:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fc600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787386.523227:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1c00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.523232:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1c00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.523238:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d07096a0100) 00010000:00010000:0.0:1787787386.523241:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787386.523243:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1c00 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.523257:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1c00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.523299:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1bf2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352ee expref: 38 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.523313:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1c07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352ee expref: 37 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.523321:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07078d0b00) 00010000:00010000:0.0:1787787386.523323:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787787386.523325:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d07059fd400, rc 0) 00000100:00100000:0.0:1787787386.523381:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+37:11489:x1874630678750208:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 962us (1168us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1787787386.523399:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 165 00000100:00100000:1.0:1787787386.535810:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787386.535860:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787386.535937:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678750464 00000100:00100000:0.0:1787787386.535946:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678750464 00000100:00100000:0.0:1787787386.536005:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 166 00000100:00100000:0.0:1787787386.536017:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+37:11489:x1874630678750464:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:0.0:1787787386.536092:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.536108:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.536119:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.536156:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.536162:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.536169:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.536175:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fdc00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787386.536179:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.536186:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.536198:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07078d0b00) 00010000:00010000:0.0:1787787386.536201:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787787386.536206:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c15 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.536212:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787386.536289:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+37:11489:x1874630678750464:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 274us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787386.536297:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 166 00000100:00100000:3.0:1787787386.536407:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678750336 00000100:00100000:3.0:1787787386.536411:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678750336 00000100:00100000:3.0:1787787386.536483:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:3.0:1787787386.536491:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032ca940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+37:2344:x1874630678750336:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787386.536502:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787386.536516:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1c07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352ee expref: 37 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787386.536526:0:8496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07078d0b00) 00010000:00010000:3.0:1787787386.536537:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787386.536557:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032ca940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+36:2344:x1874630678750336:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 68us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787386.536563:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:1.0:1787787386.542537:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787386.542604:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678750720 00000100:00100000:3.0:1787787386.542613:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678750720 00000100:00100000:3.0:1787787386.542672:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 47 00000100:00100000:3.0:1787787386.542681:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+36:11489:x1874630678750720:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:3.0:1787787386.542917:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+37:11489:x1874630678750720:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 236us (388us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1787787386.542928:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 47 00000100:00100000:2.0:1787787386.702776:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787386.703018:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678750976 00000100:00100000:0.0:1787787386.703028:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678750976 00000100:00100000:0.0:1787787386.703149:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 167 00000100:00100000:0.0:1787787386.703171:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737ea61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+37:11507:x1874630678750976:12345-192.168.206.10@tcp:101:cat.0 00010000:00010000:0.0:1787787386.703193:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787386.703212:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c352f5 expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.703321:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1c23 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.703336:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1c23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.703347:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1c23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787386.703356:0:9687:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787787386.703520:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352f5 expref: 40 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.703537:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1c23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352f5 expref: 39 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.703545:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07078d0b00) 00010000:00010000:0.0:1787787386.703548:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787787386.703551:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d07059fc600, rc 0) 00000100:00100000:0.0:1787787386.703609:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737ea61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+39:11507:x1874630678750976:12345-192.168.206.10@tcp:101:cat.0 Request processed in 440us (842us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1787787386.703617:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 167 00000100:00100000:1.0:1787787386.748775:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0601f96580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694477440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787787386.748860:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787386.748912:0:12107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694477440 00000100:00100000:2.0:1787787386.748919:0:12107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694477440 00000100:00100000:2.0:1787787386.748973:0:12107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787787386.748982:0:12107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694477440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787787386.749030:0:12107:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787386.749084:0:12107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694477440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787386.749091:0:12107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787787386.749942:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0601f96580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694477440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787787386.763238:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787386.763362:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678751104 00000100:00100000:0.0:1787787386.763374:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678751104 00000100:00100000:0.0:1787787386.763507:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 168 00000100:00100000:0.0:1787787386.763519:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+39:11508:x1874630678751104:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787787386.763552:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787386.763579:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c352fc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.763662:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1c38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.763680:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1c38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.763694:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1c38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787386.763944:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787787386.763949:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787787386.764035:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1c38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.764070:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352fc expref: 41 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.764090:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1c38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352fc expref: 40 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.764101:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:0.0:1787787386.764104:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787787386.764108:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d07059fc200, rc 0) 00000100:00100000:0.0:1787787386.764188:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+40:11508:x1874630678751104:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 671us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787386.764203:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 168 00000100:00100000:1.0:1787787386.772841:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787386.773143:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678751488 00000100:00100000:2.0:1787787386.773153:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678751488 00000100:00100000:2.0:1787787386.773216:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 48 00000100:00100000:2.0:1787787386.773226:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+40:11508:x1874630678751488:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:2.0:1787787386.773582:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+41:11508:x1874630678751488:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 356us (748us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1787787386.773590:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 48 00000100:00100000:2.0:1787787386.776621:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787386.779534:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678751616 00000100:00100000:0.0:1787787386.779549:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678751616 00000100:00100000:0.0:1787787386.779687:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:0.0:1787787386.779698:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705815050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+41:11508:x1874630678751616:12345-192.168.206.10@tcp:103:lfs.0 00010000:00010000:0.0:1787787386.779714:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787787386.779740:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1bc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352e0 expref: 41 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.779761:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1c23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352f5 expref: 40 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.779779:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b1acc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352a1 expref: 39 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.779789:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07078d0b00) 00010000:00010000:0.0:1787787386.779799:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787386.779869:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705815050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+38:11508:x1874630678751616:12345-192.168.206.10@tcp:103:lfs.0 Request processed in 172us (3255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787386.779876:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:0.0:1787787386.782423:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787386.782642:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678751744 00000100:00100000:2.0:1787787386.782651:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678751744 00000100:00100000:2.0:1787787386.782735:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 169 00000100:00100000:2.0:1787787386.782745:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0601f96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+38:11508:x1874630678751744:12345-192.168.206.10@tcp:58:lfs.0 00010000:00010000:2.0:1787787386.782865:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1c3f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.782881:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1c3f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787386.782892:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1c3f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787787386.783195:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1787787386.783286:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0601f96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+38:11508:x1874630678751744:12345-192.168.206.10@tcp:58:lfs.0 Request processed in 542us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787386.783304:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 169 00000100:00100000:1.0:1787787386.809340:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787386.809482:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678751872 00000100:00100000:0.0:1787787386.809490:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678751872 00000100:00100000:0.0:1787787386.809542:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 170 00000100:00100000:0.0:1787787386.809551:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+38:11510:x1874630678751872:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787787386.809568:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787386.809597:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1c46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35303 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.809651:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c4d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.809664:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.809675:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.809689:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1c54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.809696:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1c54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.809703:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1c54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.810026:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1c5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.810100:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.810108:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787386.810142:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787787386.810146:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787787386.810161:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.810177:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.810185:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.810192:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c4d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.810199:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.810205:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fdc00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787386.810208:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.810215:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c4d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.810226:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:0.0:1787787386.810228:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787386.810232:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.810238:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.810249:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1c54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.810255:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1c54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.810265:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1c54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.810271:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fde00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787386.810273:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1c54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.810279:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1c54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.810286:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d07096a0100) 00010000:00010000:0.0:1787787386.810288:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787386.810291:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1c54 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.810296:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1c54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.810323:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1c46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35303 expref: 40 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.810340:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1c5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35303 expref: 39 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787386.810347:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07078d0e00) 00010000:00010000:0.0:1787787386.810349:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787787386.810352:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d07059fc000, rc 0) 00000100:00100000:0.0:1787787386.810796:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+39:11510:x1874630678751872:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 1243us (1461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787386.810813:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 170 00000040:00080000:3.0:1787787387.261308:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787787387.261318:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787787387.261735:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787787387.261743:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787787387.261851:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06032eda40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874630694477568:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787787387.261950:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0601aad9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787387.264836:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06032eda40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874630694477568:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787787387.269878:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787387.270164:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678752000 00000100:00100000:3.0:1787787387.270175:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678752000 00000100:00100000:3.0:1787787387.270240:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 171 00000100:00100000:3.0:1787787387.270251:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737ea4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+39:11521:x1874630678752000:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787787387.270282:0:9687:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787787387.270395:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737ea4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+39:11521:x1874630678752000:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 135us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787387.270404:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 171 00000100:00080000:2.0:1787787387.270487:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787387.278831:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787387.278901:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678752128 00000100:00100000:0.0:1787787387.278910:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678752128 00000100:00100000:0.0:1787787387.279000:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 172 00000100:00100000:0.0:1787787387.279011:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+39:11521:x1874630678752128:12345-192.168.206.10@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787787387.279077:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1c62 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.279094:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1c62 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.279105:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1c62 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.279119:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c69 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.279127:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c69 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.279133:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c69 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.279170:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1c70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.279178:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1c70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.279193:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1c70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787387.279245:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787787387.279249:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787787387.279261:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1c70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.279273:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1c62 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.279280:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1c62 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.279287:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1c62 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.279292:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fde00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787387.279296:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1c62 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.279304:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1c62 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.279315:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d071b71da00) 00010000:00010000:0.0:1787787387.279319:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787387.279323:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1c62 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.279329:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1c62 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.279340:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c69 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.279354:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c69 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.279360:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c69 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.279366:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fdc00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787387.279369:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c69 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.279375:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c69 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.279394:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9d07096a0100) 00010000:00010000:0.0:1787787387.279397:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787387.279400:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c69 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.279406:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c69 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.279420:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1c70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.279425:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1c70 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.279464:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1c70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.279469:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fce00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787387.279478:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1c70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.279485:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1c70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.279493:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07078d0e00) 00010000:00010000:0.0:1787787387.279496:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787387.279499:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1c70 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.279505:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1c70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787387.279597:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+39:11521:x1874630678752128:12345-192.168.206.10@tcp:34:lhsmtool_posix.0 Request processed in 578us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787387.279606:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 172 00000100:00100000:2.0:1787787387.285522:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787387.285657:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678752384 00000100:00100000:3.0:1787787387.285667:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678752384 00000100:00100000:3.0:1787787387.285725:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 173 00000100:00100000:3.0:1787787387.285734:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737ea4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+39:11521:x1874630678752384:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787787387.285754:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787387.285772:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1c77 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3530a expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.285863:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1c7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.285878:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1c7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.285888:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1c7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787387.285899:0:9687:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787787387.285992:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1c7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.285999:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1c7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.286005:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1c7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.286011:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0700030e00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787387.286015:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1c7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.286045:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1c7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.286057:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07078d0e00) 00010000:00010000:3.0:1787787387.286060:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787787387.286064:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1c7e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.286070:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1c7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.286106:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1c77 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3530a expref: 41 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.286116:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d071b71da00) 00010000:00010000:3.0:1787787387.286118:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787787387.286122:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1c77 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3530a expref: 41 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.286131:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0700031c00, rc 0) 00000100:00100000:3.0:1787787387.286202:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737ea4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+40:11521:x1874630678752384:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 468us (688us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1787787387.287270:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 173 00000100:00100000:2.0:1787787387.290295:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787387.290693:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678752512 00000100:00100000:3.0:1787787387.290703:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678752512 00000100:00100000:3.0:1787787387.290765:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 174 00000100:00100000:3.0:1787787387.290786:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07185a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+40:11521:x1874630678752512:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787787387.290832:0:5821:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787787387.290936:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07185a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+40:11521:x1874630678752512:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 152us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787387.290944:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 174 00000100:00100000:3.0:1787787387.300198:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787387.301519:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678752768 00000100:00100000:0.0:1787787387.301530:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678752768 00000100:00100000:0.0:1787787387.301584:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 175 00000100:00100000:0.0:1787787387.301595:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+40:11521:x1874630678752768:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787787387.301614:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787387.301618:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787787387.301643:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1c38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c352fc expref: 40 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.301731:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:0.0:1787787387.301737:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787787387.301752:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1c8c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35311 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787787387.302769:0:5819:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1787787387.303323:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.303340:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.303350:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.303422:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1c8c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35311 expref: 42 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.303468:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35311 expref: 41 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.303477:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d07096a0100) 00010000:00010000:0.0:1787787387.303480:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787787387.303483:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d07059fdc00, rc 0) 00000100:00100000:0.0:1787787387.303552:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+41:11521:x1874630678752768:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 1959us (3361us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1787787387.303561:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 175 00000100:00100000:2.0:1787787387.316180:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787387.316281:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678753024 00000100:00100000:0.0:1787787387.316291:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678753024 00000100:00100000:0.0:1787787387.316342:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 176 00000100:00100000:0.0:1787787387.316354:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06025c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+41:11521:x1874630678753024:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787787387.316432:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787387.316492:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1c93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35311 expref: 41 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.316509:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d07096a0100) 00010000:00010000:0.0:1787787387.316518:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787787387.316537:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1ca1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.316548:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1ca1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.316557:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1ca1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.316567:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1ca8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xc4950a93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.316574:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1ca8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc4950a93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.316579:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1ca8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc4950a93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.316795:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1ca1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.316802:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1ca1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.316807:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1ca1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.316812:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fce00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787387.316820:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1ca1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.316827:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1ca1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.316834:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:0.0:1787787387.316837:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787387.316840:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1ca1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.316846:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1ca1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.316861:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1ca8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc4950a93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.316867:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1ca8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc4950a93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.316873:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1ca8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc4950a93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.316878:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fc200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787387.316881:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1ca8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc4950a93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.316887:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1ca8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc4950a93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.316894:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xc4950a93 (ffff9d07096a0600) 00010000:00010000:0.0:1787787387.316897:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787387.316906:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1ca8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc4950a93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.316912:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1ca8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc4950a93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787387.316993:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06025c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+40:11521:x1874630678753024:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 643us (822us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787787387.317002:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 176 00000100:00100000:2.0:1787787387.322518:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787387.323063:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678753152 00000100:00100000:1.0:1787787387.323073:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678753152 00000100:00100000:1.0:1787787387.323120:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 177 00000100:00100000:1.0:1787787387.323129:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06025c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+40:11521:x1874630678753152:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787787387.323149:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787387.323169:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1caf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35318 expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.323206:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d600/0xdeb1953cba4b1cb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.323219:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d600/0xdeb1953cba4b1cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.323228:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d600/0xdeb1953cba4b1cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.323323:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1caf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35318 expref: 42 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.323352:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d600/0xdeb1953cba4b1cb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35318 expref: 41 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.323360:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d07114acc00) 00010000:00010000:1.0:1787787387.323363:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787787387.323367:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1d600, rc 0) 00000100:00100000:1.0:1787787387.323461:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06025c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+41:11521:x1874630678753152:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 309us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787387.323473:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 177 00000100:00100000:3.0:1787787387.326598:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787387.327032:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678753408 00000100:00100000:1.0:1787787387.327041:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678753408 00000100:00100000:1.0:1787787387.327094:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 178 00000100:00100000:1.0:1787787387.327104:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+41:11521:x1874630678753408:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787787387.327176:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1cbd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.327193:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1cbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.327203:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1cbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787787387.327517:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1787787387.327528:0:5821:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 299554088758ns, next at 300554086531ns, rc = 0 00000004:00010000:1.0:1787787387.327611:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000098bbeb76 reply state 0000000005970c6e transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1cbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787387.327639:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787787387.327781:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+43:11521:x1874630678753408:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 677us (1190us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1787787387.327789:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 178 00010000:00010000:0.0:1787787387.329972:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1cbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.329988:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1cbd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.329996:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1cbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.330002:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1de00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787387.330007:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1cbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.330014:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1cbd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.330038:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d07114acc00) 00010000:00010000:0.0:1787787387.330041:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787787387.330046:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1cbd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.330053:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1cbd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787387.330427:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787387.330784:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678753536 00000100:00100000:0.0:1787787387.330792:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678753536 00000100:00100000:0.0:1787787387.330842:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 179 00000100:00100000:0.0:1787787387.330853:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+42:11521:x1874630678753536:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787787387.330874:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787387.330890:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1cc4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3531f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.330948:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1cc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3531f expref: 43 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.330962:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1cc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3531f expref: 43 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.330980:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d07114acc00) 00010000:00010000:0.0:1787787387.330983:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787787387.330986:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d07059fc200, rc 0) 00000100:00100000:0.0:1787787387.331041:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+43:11521:x1874630678753536:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 190us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787387.331049:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 179 00000100:00100000:2.0:1787787387.337876:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787387.338229:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678753664 00000100:00100000:0.0:1787787387.338238:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678753664 00000100:00100000:0.0:1787787387.338303:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 52 00000100:00100000:0.0:1787787387.338315:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06025c8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2345:x1874630678753664:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787787387.338661:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06025c8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2345:x1874630678753664:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 Request processed in 348us (792us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787787387.338681:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 52 00000100:00080000:2.0:1787787387.338793:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787387.341206:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787387.341373:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678753920 00000100:00100000:0.0:1787787387.341392:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678753920 00000100:00100000:0.0:1787787387.341513:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 49 00000100:00100000:0.0:1787787387.341524:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+43:11521:x1874630678753920:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787787387.341738:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+44:11521:x1874630678753920:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 215us (538us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1787787387.341745:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 49 00000100:00100000:3.0:1787787387.343970:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787387.344669:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678754176 00000100:00100000:0.0:1787787387.344680:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678754176 00000100:00100000:0.0:1787787387.344777:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 180 00000100:00100000:0.0:1787787387.344788:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+44:11521:x1874630678754176:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787787387.344913:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+44:11521:x1874630678754176:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 127us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787387.344921:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 180 00000100:00100000:2.0:1787787387.347914:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787387.348038:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678754304 00000100:00100000:1.0:1787787387.348048:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678754304 00000100:00100000:1.0:1787787387.348100:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 181 00000100:00100000:1.0:1787787387.348111:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705974b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+44:11521:x1874630678754304:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787787387.348131:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787387.348150:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1ccb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35326 expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.348213:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1cd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.348227:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.348238:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787387.348272:0:9687:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787787387.348290:0:9687:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.348315:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1ccb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35326 expref: 46 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.348352:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1cd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35326 expref: 45 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.348361:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d07114acc00) 00010000:00010000:1.0:1787787387.348364:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787787387.348367:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1da00, rc 0) 00000100:00100000:1.0:1787787387.348472:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705974b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+45:11521:x1874630678754304:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 327us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787387.348480:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 181 00000100:00100000:2.0:1787787387.351534:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787387.351731:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678754432 00000100:00100000:1.0:1787787387.351741:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678754432 00000100:00100000:1.0:1787787387.351806:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 53 00000100:00100000:1.0:1787787387.351817:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705975680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2344:x1874630678754432:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787787387.351835:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787387.351865:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5094663/0xdeb1953cba4b1cd9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3532d expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787787387.351891:0:6674:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f787b, blocks: 0x1 00010000:00010000:1.0:1787787387.351911:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=299s v=(0 0) 00010000:00010000:1.0:1787787387.351915:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787387.351924:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5094663/0xdeb1953cba4b1cd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3532d expref: 8 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.351941:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d5094663/0xdeb1953cba4b1cd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3532d expref: 8 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.351973:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1ce00, rc 0) 00000100:00100000:1.0:1787787387.352034:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705975680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+8:2344:x1874630678754432:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 220us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787387.352042:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 53 00000100:00100000:3.0:1787787387.357051:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787387.357235:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678754688 00000100:00100000:0.0:1787787387.357245:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678754688 00000100:00100000:0.0:1787787387.357301:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 182 00000100:00100000:0.0:1787787387.357311:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+45:11521:x1874630678754688:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787787387.357541:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+45:11521:x1874630678754688:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 231us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787387.357549:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 182 00000100:00100000:3.0:1787787387.362852:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787387.362931:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678754816 00000100:00100000:0.0:1787787387.362940:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678754816 00000100:00100000:0.0:1787787387.363037:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 54 00000100:00100000:0.0:1787787387.363048:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+8:11521:x1874630678754816:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787787387.363072:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787387.363089:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c22c3109/0xdeb1953cba4b1ce0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35334 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.363125:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d5094663/0xdeb1953cba4b1cd9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3532d expref: 9 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.363140:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787387.363144:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787387.363149:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c22c3109/0xdeb1953cba4b1ce0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35334 expref: 9 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.363194:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d5094663/0xdeb1953cba4b1cd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3532d expref: 9 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.363208:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d5094663/0xdeb1953cba4b1cd9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3532d expref: 9 pid: 6674 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787387.363229:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0601f94b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6673:1874630694477696:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787787387.363352:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0708ad8300 going to sleep for 11 seconds 00000100:00100000:1.0:1787787387.369806:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0601f94b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6673:1874630694477696:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787787387.369846:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c22c3109/0xdeb1953cba4b1ce0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35334 expref: 9 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.369866:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d07059fce00, rc 0) 00000100:00100000:1.0:1787787387.369925:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+9:11521:x1874630678754816:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 6879us (7096us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787387.369934:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 54 00000100:00100000:1.0:1787787387.376136:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787387.376358:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678754944 00000100:00100000:3.0:1787787387.376366:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678754944 00010000:00010000:3.0:1787787387.376416:0:8496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d5094663/0xdeb1953cba4b1cd9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3532d expref: 9 pid: 6674 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787387.376468:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 69 00000100:00100000:3.0:1787787387.376478:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+9:2345:x1874630678754944:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787387.376493:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787387.376512:0:8496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d5094663/0xdeb1953cba4b1cd9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3532d expref: 9 pid: 6674 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.376525:0:8496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d5094663/0xdeb1953cba4b1cd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3532d expref: 9 pid: 6674 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.376546:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5094663/0xdeb1953cba4b1cd9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3532d expref: 9 pid: 6674 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.376570:0:8496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787387.376574:0:8496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787387.376582:0:8496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c22c3109/0xdeb1953cba4b1ce0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35334 expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.376592:0:8496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c22c3109/0xdeb1953cba4b1ce0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35334 expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.376624:0:8496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c22c3109/0xdeb1953cba4b1ce0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35334 expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787387.376638:0:8496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06032ed680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8496:1874630694477824:192.168.206.10@tcp:105: 00000100:00100000:3.0:1787787387.377470:0:8496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0601aada80 going to sleep for 11 seconds 00000100:00100000:2.0:1787787387.391994:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787387.392056:0:8496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06032ed680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8496:1874630694477824:192.168.206.10@tcp:105: 00010000:00010000:2.0:1787787387.392079:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787387.392141:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+8:2345:x1874630678754944:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 15664us (16013us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787387.392152:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 69 00000100:00100000:2.0:1787787387.392188:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678755072 00000100:00100000:2.0:1787787387.392194:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678755072 00002000:00100000:2.0:1787787387.392229:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9d060260f840 x1874630678755072/t0(0) o4->c5599457-aa74-4a71-951f-faabe33e6ec7@192.168.206.10@tcp:248/0 lens 504/0 e 0 to 0 dl 1787787398 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787787387.392240:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d060260f840 with x1874630678755072 ext(0->8) 00002000:00010000:2.0:1787787387.392244:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d060260f840 00000100:00100000:2.0:1787787387.392265:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:2.0:1787787387.392273:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d060260f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+8:2344:x1874630678755072:12345-192.168.206.10@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787787387.392704:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d060260f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+10:2344:x1874630678755072:12345-192.168.206.10@tcp:4:lhsmtool_posix.0 Request processed in 430us (877us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1787787387.392711:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 5 00002000:00100000:2.0:1787787387.392718:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9d060260f840 x1874630678755072/t4294967315(0) o4->c5599457-aa74-4a71-951f-faabe33e6ec7@192.168.206.10@tcp:248/0 lens 504/448 e 0 to 0 dl 1787787398 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787787387.392726:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d060260f840 with x1874630678755072 ext(0->8) 00002000:00010000:2.0:1787787387.392729:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d060260f840 00000100:00100000:2.0:1787787387.400578:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787387.400693:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678755200 00000100:00100000:1.0:1787787387.400703:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678755200 00000100:00100000:1.0:1787787387.400796:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 183 00000100:00100000:1.0:1787787387.400806:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d060260e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+45:11521:x1874630678755200:12345-192.168.206.10@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787787387.444487:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d060260e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+45:11521:x1874630678755200:12345-192.168.206.10@tcp:44:lhsmtool_posix.0 Request processed in 43674us (43909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787387.444501:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 183 00000001:00080000:0.0:1787787387.444686:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:0.0:1787787387.444709:0:5842:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:0.0:1787787387.444761:0:5842:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:1.0:1787787387.444951:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787787387.444967:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06032c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694477952:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787787387.445017:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787387.445095:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694477952 00000100:00100000:1.0:1787787387.445103:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694477952 00000100:00100000:1.0:1787787387.445263:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787787387.445272:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694477952:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787787387.445435:0:6674:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787787387.445668:0:6674:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787787387 00002000:00010000:1.0:1787787387.445671:0:6674:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787787387.445673:0:6674:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787787387 -> 1787787387 00002000:00010000:1.0:1787787387.445675:0:6674:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787787387.445718:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3291:x1874630694477952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 447us (701us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787787387.445726:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:1.0:1787787387.445762:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d06032c92c0/2, rc 0, transno 4294967316 00000100:00080000:2.0:1787787387.445977:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787387.446266:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06032c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694477952:0@lo:2:osp-syn-0-0.0 00000020:00080000:3.0:1787787387.447567:0:5853:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1787787387.447583:0:5853:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1787787387.454880:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787387.456416:0:10776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678755328 00000100:00100000:3.0:1787787387.456428:0:10776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678755328 00000100:00100000:3.0:1787787387.456517:0:10776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 56 00000100:00100000:3.0:1787787387.456527:0:10776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+10:2343:x1874630678755328:12345-192.168.206.10@tcp:16:lhsmtool_posix.0 00000040:00080000:3.0:1787787387.504973:0:12498:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787787387.504982:0:12498:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787787387.505293:0:12498:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787787387.505298:0:12498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1787787387.515252:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:2.0:1787787387.515266:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:2.0:1787787387.515272:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:0.0:1787787387.515408:0:10776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2343:x1874630678755328:12345-192.168.206.10@tcp:16:lhsmtool_posix.0 Request processed in 58877us (60530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787387.515427:0:10776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 56 00000100:00100000:1.0:1787787387.518515:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787387.518556:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678755584 00000100:00100000:1.0:1787787387.518565:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678755584 00000100:00100000:1.0:1787787387.518611:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 184 00000100:00100000:1.0:1787787387.518621:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+18:11521:x1874630678755584:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787787387.518677:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787387.518702:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1cd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35326 expref: 18 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.518970:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d07114acc00) 00010000:00010000:1.0:1787787387.518976:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787787387.519005:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d200/0xdeb1953cba4b1ce7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.519038:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d200/0xdeb1953cba4b1ce7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.519048:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d200/0xdeb1953cba4b1ce7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.519122:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:1.0:1787787387.519273:0:5820:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000289a3945 reply state 00000000e92ae083 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d200/0xdeb1953cba4b1ce7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787387.519282:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787787387.519365:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+19:11521:x1874630678755584:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 746us (857us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1787787387.519373:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 184 00010000:00010000:0.0:1787787387.521331:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d200/0xdeb1953cba4b1ce7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.521344:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d200/0xdeb1953cba4b1ce7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.521352:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d200/0xdeb1953cba4b1ce7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.521359:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1d200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787387.521363:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d200/0xdeb1953cba4b1ce7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.521371:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d200/0xdeb1953cba4b1ce7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.521396:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d07114acc00) 00010000:00010000:0.0:1787787387.521400:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787387.521404:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d200/0xdeb1953cba4b1ce7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.521411:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d200/0xdeb1953cba4b1ce7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787387.528474:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787387.528715:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678755712 00000100:00100000:3.0:1787787387.528734:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678755712 00000100:00100000:3.0:1787787387.529762:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 57 00000100:00100000:3.0:1787787387.529787:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d060260e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2344:x1874630678755712:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787787387.530145:0:6674:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787787387.530150:0:6674:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787787387 -> 1787787386 00002000:00010000:3.0:1787787387.530153:0:6674:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787787384 00002000:00010000:3.0:1787787387.530156:0:6674:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787787387 -> 1787787386 00002000:00010000:3.0:1787787387.530158:0:6674:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787787387.530252:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d060260e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+8:2344:x1874630678755712:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 Request processed in 474us (1785us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1787787387.530263:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 57 00000100:00100000:2.0:1787787387.545496:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787387.545568:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678755968 00000100:00100000:0.0:1787787387.545577:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678755968 00000100:00100000:0.0:1787787387.545625:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 185 00000100:00100000:0.0:1787787387.545638:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d060260c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+18:11521:x1874630678755968:12345-192.168.206.10@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787787387.545712:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1cee lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.545730:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d600/0xdeb1953cba4b1cb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35318 expref: 18 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.545740:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1cee lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.545772:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d600/0xdeb1953cba4b1cb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35318 expref: 18 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.545787:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d600/0xdeb1953cba4b1cb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35318 expref: 18 pid: 9687 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787387.545801:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0601f943c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5819:1874630694478080:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787787387.545903:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0707822780 going to sleep for 11 seconds 00000100:00100000:1.0:1787787387.550309:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0601f943c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5819:1874630694478080:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787787387.550343:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1cee lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787387.554226:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787387.556378:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678756096 00000100:00100000:2.0:1787787387.556411:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678756096 00010000:00010000:2.0:1787787387.557090:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d600/0xdeb1953cba4b1cb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35318 expref: 19 pid: 9687 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787387.557180:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 70 00000100:00100000:2.0:1787787387.557194:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0601f96d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+19:2345:x1874630678756096:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787387.557215:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787387.557223:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d600/0xdeb1953cba4b1cb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35318 expref: 19 pid: 9687 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787387.557238:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d600/0xdeb1953cba4b1cb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35318 expref: 19 pid: 9687 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787387.557272:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d600/0xdeb1953cba4b1cb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35318 expref: 19 pid: 9687 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787387.557288:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d07114acc00) 00010000:00010000:2.0:1787787387.557294:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1cee lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787387.557305:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1cee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787387.557313:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1cee lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787387.557354:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787387.557459:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0601f96d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+18:2345:x1874630678756096:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 268us (3246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787387.557467:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 70 00010000:00010000:1.0:1787787387.557565:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1cee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.557573:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1cee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.557610:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1cee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.557618:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1cee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.557624:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1cee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.557641:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fde00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787387.557646:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1cee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.557654:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1cee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.557664:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d07114acc00) 00010000:00010000:1.0:1787787387.557667:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787787387.557672:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1cee lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.557678:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1cee lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787387.557737:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d060260c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+17:11521:x1874630678755968:12345-192.168.206.10@tcp:55:lhsmtool_posix.0 Request processed in 12102us (12248us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787787387.557746:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 185 00000100:00100000:0.0:1787787387.560533:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787387.560610:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678756224 00000100:00100000:1.0:1787787387.560620:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678756224 00000100:00100000:1.0:1787787387.560677:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 58 00000100:00100000:1.0:1787787387.560686:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0601f961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+8:2343:x1874630678756224:12345-192.168.206.10@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787787387.560738:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000d8fedea/0xdeb1953cba4b1cf5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.560761:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c22c3109/0xdeb1953cba4b1ce0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35334 expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.560931:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787387.560936:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787787387.560942:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d8fedea/0xdeb1953cba4b1cf5 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.560989:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c22c3109/0xdeb1953cba4b1ce0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35334 expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.561006:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c22c3109/0xdeb1953cba4b1ce0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35334 expref: 8 pid: 6673 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787387.561089:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06032c8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6673:1874630694478208:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787787387.561193:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071046c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787387.565156:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787387.565285:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06032c8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6673:1874630694478208:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787787387.565321:0:6673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000d8fedea/0xdeb1953cba4b1cf5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787387.565389:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678756352 00000100:00100000:3.0:1787787387.565397:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678756352 00010000:00010000:3.0:1787787387.565589:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c22c3109/0xdeb1953cba4b1ce0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35334 expref: 9 pid: 6673 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787387.565666:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 71 00000100:00100000:3.0:1787787387.565678:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+9:2344:x1874630678756352:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787387.565699:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787387.565726:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c22c3109/0xdeb1953cba4b1ce0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35334 expref: 9 pid: 6673 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.565741:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c22c3109/0xdeb1953cba4b1ce0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35334 expref: 9 pid: 6673 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.565778:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c22c3109/0xdeb1953cba4b1ce0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35334 expref: 9 pid: 6673 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.565899:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787787387.565904:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787787387.565910:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000d8fedea/0xdeb1953cba4b1cf5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.565922:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d8fedea/0xdeb1953cba4b1cf5 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.565989:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787387.566066:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+8:2344:x1874630678756352:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 390us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787387.566074:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 71 00010000:00010000:1.0:1787787387.566333:0:6673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000d8fedea/0xdeb1953cba4b1cf5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.566343:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d8fedea/0xdeb1953cba4b1cf5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.566374:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000d8fedea/0xdeb1953cba4b1cf5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.566394:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d8fedea/0xdeb1953cba4b1cf5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.566417:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d8fedea/0xdeb1953cba4b1cf5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.566425:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1da00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:1.0:1787787387.566430:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d8fedea/0xdeb1953cba4b1cf5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.566512:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d8fedea/0xdeb1953cba4b1cf5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.566527:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d8fedea/0xdeb1953cba4b1cf5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.566536:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d8fedea/0xdeb1953cba4b1cf5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787387.566591:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0601f961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2343:x1874630678756224:12345-192.168.206.10@tcp:1:lhsmtool_posix.0 Request processed in 5906us (6072us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787387.566601:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 58 00000100:00100000:3.0:1787787387.569537:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787387.570104:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678756608 00000100:00100000:0.0:1787787387.570119:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678756608 00000100:00100000:0.0:1787787387.570235:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 186 00000100:00100000:0.0:1787787387.570247:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+17:11521:x1874630678756608:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787787387.570350:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1cfc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.570371:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1cfc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.570416:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1cfc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.570706:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b1d03 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.570718:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1cc4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3531f expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.570727:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b1d03 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.570780:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1cc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3531f expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787387.570797:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1cc4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3531f expref: 18 pid: 5819 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787387.570814:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0601f952c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5821:1874630694478336:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787787387.570914:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0707822cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787387.574613:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787387.574635:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0601f952c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5821:1874630694478336:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787787387.574671:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b1d03 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787387.574750:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678756736 00000100:00100000:2.0:1787787387.574759:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678756736 00010000:00010000:2.0:1787787387.574890:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1cc4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3531f expref: 19 pid: 5819 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787387.574930:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 72 00000100:00100000:2.0:1787787387.574948:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0601f97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+19:2345:x1874630678756736:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787387.574968:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787387.574975:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1cc4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3531f expref: 19 pid: 5819 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787387.574987:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1cc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3531f expref: 19 pid: 5819 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787387.575013:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1cc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3531f expref: 19 pid: 5819 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787387.575217:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d07114acc00) 00010000:00010000:2.0:1787787387.575223:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b1d03 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787387.575234:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b1d03 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787387.575243:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b1d03 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787387.575310:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787387.575393:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0601f97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+18:2345:x1874630678756736:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 434us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787387.575402:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 72 00010000:00010000:1.0:1787787387.575542:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b1d03 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.575565:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b1d03 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787787387.576631:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1787787387.577012:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1787787387.577066:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1787787387.577258:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06032c9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5821:1874630694478464:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787787387.577348:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787387.577408:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0707822480 going to sleep for 11 seconds 00000100:00100000:1.0:1787787387.577572:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694478464 00000100:00100000:1.0:1787787387.577582:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694478464 00000100:00100000:1.0:1787787387.577638:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787787387.577647:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0601f94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5821:x1874630694478464:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787787387.577813:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0601f94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5821:x1874630694478464:12345-0@lo:1000:mdt00_002.0 Request processed in 157us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787387.577820:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787787387.578060:0:5821:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1787787387.578067:0:5821:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d06032c92c0, transno 4294967316 00000100:00100000:2.0:1787787387.578088:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06032c9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5821:1874630694478464:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787787387.579154:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1787787387.579250:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d060260cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5821:1874630694478592:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787787387.579325:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787387.579374:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071046c300 going to sleep for 11 seconds 00000100:00100000:0.0:1787787387.579691:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694478592 00000100:00100000:0.0:1787787387.579700:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694478592 00000100:00100000:0.0:1787787387.579865:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787787387.579877:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d060260d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5821:x1874630694478592:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787787387.581910:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d060260d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5821:x1874630694478592:12345-0@lo:1000:mdt00_002.0 Request processed in 2022us (2571us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1787787387.581928:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787787387.584608:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d060260cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5821:1874630694478592:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1787787387.584684:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b1d03 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.584698:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b1d03 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.584706:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b1d03 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.584713:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fd600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787387.584783:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b1d03 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.584820:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b1d03 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.584841:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d07114acc00) 00010000:00010000:3.0:1787787387.584844:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787787387.584850:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b1d03 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.584856:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b1d03 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.584901:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1c3f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.584908:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1c3f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.584915:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1c3f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.584921:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787387.584924:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1c3f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.584931:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1c3f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.584940:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07078d0e00) 00010000:00010000:3.0:1787787387.584942:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787787387.584945:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1c3f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.584961:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1c3f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.584990:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1d0a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.585011:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1c5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35303 expref: 21 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.585022:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1d0a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.586713:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1c5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35303 expref: 21 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.586788:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1c5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35303 expref: 21 pid: 5820 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787387.586807:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06032eed00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5821:1874630694478720:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787787387.586981:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0706603180 going to sleep for 11 seconds 00000100:00100000:3.0:1787787387.596894:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06032eed00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5821:1874630694478720:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787787387.596932:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1d0a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787387.597476:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787387.597570:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678756864 00000100:00100000:3.0:1787787387.597578:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678756864 00010000:00010000:3.0:1787787387.597623:0:8496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1c5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35303 expref: 22 pid: 5820 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787387.597689:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 73 00000100:00100000:3.0:1787787387.597700:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0601f95e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+22:2344:x1874630678756864:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787387.597720:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787387.597728:0:8496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1c5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35303 expref: 22 pid: 5820 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.597743:0:8496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1c5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35303 expref: 22 pid: 5820 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.597780:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1c5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35303 expref: 22 pid: 5820 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.597809:0:8496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07078d0e00) 00010000:00010000:3.0:1787787387.597815:0:8496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1d0a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.597826:0:8496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1d0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.597836:0:8496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1d0a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.597861:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787387.597922:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0601f95e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+21:2344:x1874630678756864:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 223us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787387.597931:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 73 00010000:00010000:1.0:1787787387.598645:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1d0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.598658:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1d0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.598672:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1d0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.598679:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1d0a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.598686:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1d0a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.598693:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0700030e00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787387.598697:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1d0a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.598719:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1d0a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.598733:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07078d0e00) 00010000:00010000:1.0:1787787387.598736:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787387.598740:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1d0a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.598747:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1d0a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.598761:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1cfc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.598767:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1cfc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.598773:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1cfc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.598778:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fd200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787387.598781:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1cfc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.598787:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1cfc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.598795:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07078d0e00) 00010000:00010000:1.0:1787787387.598797:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787787387.598799:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1cfc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.598815:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1cfc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787387.599192:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+20:11521:x1874630678756608:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 28942us (29662us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1787787387.599205:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 186 00000020:00080000:0.0:1787787387.599211:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787787387.599395:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787787387.599407:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787787387.599960:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1787787387.599972:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787787387.602041:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787387.602153:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678757120 00000100:00100000:3.0:1787787387.602165:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678757120 00000100:00100000:3.0:1787787387.602238:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 50 00000100:00100000:3.0:1787787387.602250:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703164850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+20:11521:x1874630678757120:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787787387.603914:0:5822:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787787387.604159:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1787787387.604235:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1d11 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.604257:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1d11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.604270:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1d11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.604279:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1d11 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.604286:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1d11 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.604293:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1d11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787387.604317:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787787387.604533:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703164850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+22:11521:x1874630678757120:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 2281us (2509us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1787787387.604545:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 50 00000020:00080000:3.0:1787787387.604557:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787787387.605603:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787387.605617:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1d11 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.605627:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0700031c00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:1.0:1787787387.605631:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1d11 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.605642:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1d11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.605660:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d071b71d700) 00010000:00010000:1.0:1787787387.605664:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787787387.605668:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1d11 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.605674:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1d11 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787387.605694:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787387.605695:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787387.605697:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787787388.355810:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:2.0:1787787388.355920:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00010000:00010000:2.0:1787787388.542125:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787388.898657:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787388.898714:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787388.898740:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678757248 00000100:00100000:3.0:1787787388.898754:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678757248 00000100:00100000:0.0:1787787388.898780:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678757376 00000100:00100000:0.0:1787787388.898785:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678757376 00000100:00100000:0.0:1787787388.898831:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 144 00000100:00100000:0.0:1787787388.898843:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+22:2342:x1874630678757376:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787388.898886:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 289 00000100:00100000:3.0:1787787388.898898:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2342:x1874630678757248:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787388.898944:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2342:x1874630678757248:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 48us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787388.898953:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 289 00000100:00100000:0.0:1787787388.899331:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+22:2342:x1874630678757376:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 99us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787388.899343:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 144 00000100:00100000:0.0:1787787388.903325:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787388.903497:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787388.910990:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787388.912294:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678757760 00000100:00100000:0.0:1787787388.912308:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678757760 00000100:00100000:0.0:1787787388.912409:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 145 00000100:00100000:0.0:1787787388.912421:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0601f970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2345:x1874630678757760:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787787388.912543:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0601f970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2345:x1874630678757760:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 124us (1567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787388.912552:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 145 00000100:00080000:0.0:1787787388.912588:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787388.916954:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678757632 00000100:00100000:3.0:1787787388.916973:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678757632 00000100:00100000:3.0:1787787388.917069:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678757504 00000100:00100000:3.0:1787787388.917073:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678757504 00000100:00100000:3.0:1787787388.917111:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 84 00000100:00100000:3.0:1787787388.917122:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0601f94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2345:x1874630678757632:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787388.917216:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0601f94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2345:x1874630678757632:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 96us (13905us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787388.917224:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 84 00000100:00100000:3.0:1787787388.917248:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 85 00000100:00100000:3.0:1787787388.917254:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0601f94f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2345:x1874630678757504:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787388.917282:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0601f94f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2345:x1874630678757504:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 28us (13785us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787388.917288:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 85 00000100:00080000:3.0:1787787388.917321:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1787787389.277884:0:12551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787787389.277897:0:12551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787787389.277956:0:12551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787787389.277971:0:12551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787787389.393136:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787389.393224:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678758016 00000100:00100000:1.0:1787787389.393238:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678758016 00000100:00100000:1.0:1787787389.393323:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 187 00000100:00100000:1.0:1787787389.393335:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+22:11539:x1874630678758016:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787787389.393382:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787389.393409:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1d18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3533b expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.393756:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d600/0xdeb1953cba4b1d1f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.393772:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d600/0xdeb1953cba4b1d1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.393787:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d600/0xdeb1953cba4b1d1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787389.393799:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1787787389.393993:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1d18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3533b expref: 25 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.394013:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d600/0xdeb1953cba4b1d1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3533b expref: 24 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.394023:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:1.0:1787787389.394026:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787787389.394030:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1d600, rc 0) 00000100:00100000:1.0:1787787389.394107:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+24:11539:x1874630678758016:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 775us (985us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1787787389.394117:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 187 00000100:00080000:3.0:1787787389.394399:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787787389.397074:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787389.397235:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678758144 00000100:00100000:3.0:1787787389.397247:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678758144 00000100:00100000:3.0:1787787389.397317:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 188 00000100:00100000:3.0:1787787389.397328:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+24:11539:x1874630678758144:12345-192.168.206.10@tcp:34:lfs.0 00010000:00010000:3.0:1787787389.397466:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1d2d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.397488:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1d2d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.397500:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1d2d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.397518:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1d34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.397525:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1d34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.397530:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1d34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.398315:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1d3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.398331:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1d3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.398340:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1d3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787787389.398414:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1d3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.398430:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1d2d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.398468:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1d2d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.398477:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1d2d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.398484:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0700031c00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787389.398488:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1d2d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.398497:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1d2d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.398511:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:3.0:1787787389.398514:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787389.398519:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1d2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.398525:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1d2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.398539:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1d34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.398544:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1d34 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.398557:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1d34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.398563:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0700030e00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787389.398566:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1d34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.398573:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1d34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.398580:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d071b71df00) 00010000:00010000:3.0:1787787389.398582:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787389.398586:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1d34 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.398592:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030e00/0xdeb1953cba4b1d34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.398608:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1d3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.398614:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1d3b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.398619:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1d3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.398623:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0700031a00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787389.398626:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1d3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.398642:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1d3b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.398650:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d071b71dd00) 00010000:00010000:3.0:1787787389.398653:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787389.398656:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1d3b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.398661:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1d3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787389.399524:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+24:11539:x1874630678758144:12345-192.168.206.10@tcp:34:lfs.0 Request processed in 2186us (2452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787389.399539:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 188 00000100:00100000:1.0:1787787389.449270:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787389.449616:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678758400 00000100:00100000:0.0:1787787389.449629:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678758400 00000100:00100000:0.0:1787787389.449707:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 189 00000100:00100000:0.0:1787787389.449719:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+24:11542:x1874630678758400:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787787389.449745:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787389.449858:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b1d42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35342 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.449958:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd000/0xdeb1953cba4b1d49 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.449977:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd000/0xdeb1953cba4b1d49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.449989:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd000/0xdeb1953cba4b1d49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.450003:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1d50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.450010:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.450148:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.450568:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd800/0xdeb1953cba4b1d57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.450577:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd800/0xdeb1953cba4b1d57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.450594:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd800/0xdeb1953cba4b1d57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787389.450605:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787787389.450718:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd000/0xdeb1953cba4b1d49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.450727:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd000/0xdeb1953cba4b1d49 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.450734:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd000/0xdeb1953cba4b1d49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.450741:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fd000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787389.450746:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd000/0xdeb1953cba4b1d49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.450754:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd000/0xdeb1953cba4b1d49 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.450990:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:0.0:1787787389.450994:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787389.451000:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd000/0xdeb1953cba4b1d49 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.451007:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd000/0xdeb1953cba4b1d49 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.451095:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.451102:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1d50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.451114:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1d50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.451120:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fc200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787389.451123:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1d50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.451130:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1d50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.451138:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d07096a0600) 00010000:00010000:0.0:1787787389.451140:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787389.451144:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1d50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.451149:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1d50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.451215:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b1d42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35342 expref: 27 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.451230:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd800/0xdeb1953cba4b1d57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35342 expref: 26 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.451238:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07096a0100) 00010000:00010000:0.0:1787787389.451240:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787787389.451243:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d07059fd800, rc 0) 00000100:00100000:0.0:1787787389.451334:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+26:11542:x1874630678758400:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 1616us (2077us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1787787389.451358:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 189 00000100:00100000:0.0:1787787389.457829:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787389.457883:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678758528 00000100:00100000:1.0:1787787389.457907:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678758528 00000100:00100000:1.0:1787787389.457988:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 190 00000100:00100000:1.0:1787787389.457999:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0601f97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+26:11542:x1874630678758528:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:1.0:1787787389.458340:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1d65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.458361:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1d65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.458386:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1d65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.458420:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1d65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.458426:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1d65 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.458434:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1d65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.458532:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1da00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787389.458537:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1d65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.458545:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1d65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.458559:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07096a0100) 00010000:00010000:1.0:1787787389.458562:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787787389.458567:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1d65 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.458586:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1d65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787389.458710:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0601f97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+26:11542:x1874630678758528:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 711us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787389.458719:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 190 00000100:00100000:2.0:1787787389.461752:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787389.461871:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678758784 00000100:00100000:0.0:1787787389.461884:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678758784 00000100:00100000:0.0:1787787389.462011:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 51 00000100:00100000:0.0:1787787389.462024:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d060260c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+26:11542:x1874630678758784:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:0.0:1787787389.462604:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d060260c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+27:11542:x1874630678758784:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 580us (865us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1787787389.462614:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 51 00000100:00100000:0.0:1787787389.514875:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787389.515403:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678759040 00000100:00100000:2.0:1787787389.515416:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678759040 00000100:00100000:2.0:1787787389.515518:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 191 00000100:00100000:2.0:1787787389.515529:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0601f95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+27:11069:x1874630678759040:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:2.0:1787787389.515557:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787389.515580:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b1d6c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35349 expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787389.515695:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1d73 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787389.515711:0:9687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd800/0xdeb1953cba4b1d57 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35342 expref: 28 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787389.515722:0:9687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1d73 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787389.515759:0:9687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd800/0xdeb1953cba4b1d57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35342 expref: 28 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787389.515773:0:9687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd800/0xdeb1953cba4b1d57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35342 expref: 28 pid: 5819 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787389.515803:0:9687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d060260ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9687:1874630694478848:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787787389.515917:0:9687:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0708759780 going to sleep for 11 seconds 00000100:00100000:1.0:1787787389.518783:0:9687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d060260ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9687:1874630694478848:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787787389.518826:0:9687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1d73 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787389.518943:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787389.519006:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678759168 00000100:00100000:1.0:1787787389.519015:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678759168 00010000:00010000:1.0:1787787389.519060:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd800/0xdeb1953cba4b1d57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35342 expref: 29 pid: 5819 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787389.519105:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 74 00000100:00100000:1.0:1787787389.519115:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d060260e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+29:2345:x1874630678759168:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787787389.519133:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787389.519141:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd800/0xdeb1953cba4b1d57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35342 expref: 29 pid: 5819 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.519155:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd800/0xdeb1953cba4b1d57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35342 expref: 29 pid: 5819 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.519181:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd800/0xdeb1953cba4b1d57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35342 expref: 29 pid: 5819 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.519222:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07096a0100) 00010000:00010000:1.0:1787787389.519228:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1d73 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.519238:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1d73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.519247:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1d73 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.519280:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787389.519353:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d060260e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+28:2345:x1874630678759168:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 239us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787389.519361:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 74 00010000:00010000:3.0:1787787389.521666:0:9687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1d73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.521685:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1d73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787389.521714:0:9687:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787787389.521932:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38200/0xdeb1953cba4b1d6c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35349 expref: 29 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.521957:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1d73 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35349 expref: 28 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.521968:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07096a0100) 00010000:00010000:3.0:1787787389.521971:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787787389.521991:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd39000, rc 0) 00000100:00100000:3.0:1787787389.522073:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0601f95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+28:11069:x1874630678759040:12345-192.168.206.10@tcp:101:bash.0 Request processed in 6544us (7209us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1787787389.522084:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 191 00000100:00100000:1.0:1787787389.526867:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787389.527099:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678759424 00000100:00100000:0.0:1787787389.527113:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678759424 00000100:00100000:0.0:1787787389.527187:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 192 00000100:00100000:0.0:1787787389.527199:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+28:11069:x1874630678759424:12345-192.168.206.10@tcp:36:bash.0 00010000:00010000:0.0:1787787389.527593:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1d81 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.527615:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1d81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.527632:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1d81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787787389.528189:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1787787389.528230:0:5820:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001dc62f93 reply state 000000000ec049b6 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1d81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787389.528242:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787787389.528298:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1787787389.528531:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+32:11069:x1874630678759424:12345-192.168.206.10@tcp:36:bash.0 Request processed in 1331us (1674us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1787787389.528541:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 192 00000020:00080000:1.0:1787787389.528546:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1787787389.538690:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1d81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.538717:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1d81 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787389.538750:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00010000:00010000:0.0:1787787389.538763:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1d81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.538774:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fc200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787389.538780:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1d81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.538794:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1d81 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.538820:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07096a0100) 00010000:00010000:0.0:1787787389.538823:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787389.538828:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1d81 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.538835:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1d81 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787389.538909:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678759552 00000100:00100000:3.0:1787787389.538922:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678759552 00000100:00100000:3.0:1787787389.538989:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 193 00000100:00100000:3.0:1787787389.539001:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+31:11069:x1874630678759552:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:3.0:1787787389.539031:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787389.539054:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1d88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35350 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.539129:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1d88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35350 expref: 32 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.539144:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1d88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35350 expref: 32 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.539165:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07096a0100) 00010000:00010000:3.0:1787787389.539167:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787787389.539170:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0700031a00, rc 0) 00000100:00100000:3.0:1787787389.539309:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+32:11069:x1874630678759552:12345-192.168.206.10@tcp:101:bash.0 Request processed in 310us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787389.539318:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 193 00000100:00100000:2.0:1787787389.545808:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787389.547729:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678759680 00000100:00100000:3.0:1787787389.547749:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678759680 00000100:00100000:3.0:1787787389.547916:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 59 00000100:00100000:3.0:1787787389.547932:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d060260d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+7:11069:x1874630678759680:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:3.0:1787787389.547975:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787389.548003:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000678d735f/0xdeb1953cba4b1d8f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35357 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787787389.548036:0:6675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8f787a, atime: 0x6a8f7878, ctime: 0x6a8f787a, blocks: 0xb 00010000:00010000:3.0:1787787389.548064:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=301s v=(0 0) 00010000:00010000:3.0:1787787389.548070:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787389.548081:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000678d735f/0xdeb1953cba4b1d8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35357 expref: 8 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.548102:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000678d735f/0xdeb1953cba4b1d8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35357 expref: 8 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.548117:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0700030e00, rc 0) 00000100:00100000:3.0:1787787389.548208:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d060260d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+8:11069:x1874630678759680:12345-192.168.206.10@tcp:101:bash.0 Request processed in 282us (2414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787389.548216:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 59 00000100:00080000:0.0:1787787389.548289:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787787389.554864:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787389.558083:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678759808 00000100:00100000:2.0:1787787389.558104:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678759808 00002000:00010000:2.0:1787787389.558164:0:6678:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1787787389.558170:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d0601f952c0 with x1874630678759808 ext(0->18446744073709551615) 00002000:00010000:2.0:1787787389.558185:0:6678:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d0601f952c0. 00000100:00100000:2.0:1787787389.558241:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:2.0:1787787389.558253:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0601f952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+8:2342:x1874630678759808:12345-192.168.206.10@tcp:10:bash.0 00002000:00010000:2.0:1787787389.558811:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787787389.558817:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787787386 -> 1787787389 00002000:00010000:2.0:1787787389.558820:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1787787384 -> 1787787384 00002000:00010000:2.0:1787787389.558823:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787787386 -> 1787787389 00002000:00010000:2.0:1787787389.558826:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787787389.558901:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0601f952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+9:2342:x1874630678759808:12345-192.168.206.10@tcp:10:bash.0 Request processed in 650us (4049us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1787787389.558911:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 6 00002000:00010000:2.0:1787787389.558916:0:6678:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1787787389.558919:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d0601f952c0 with x1874630678759808 ext(0->18446744073709551615) 00002000:00010000:2.0:1787787389.558925:0:6678:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d0601f952c0. 00010000:00010000:3.0:1787787389.566231:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787389.654399:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787389.654581:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678759936 00000100:00100000:0.0:1787787389.654594:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678759936 00000100:00100000:0.0:1787787389.654669:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 194 00000100:00100000:0.0:1787787389.654679:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+32:11556:x1874630678759936:12345-192.168.206.10@tcp:34:lfs.0 00010000:00010000:0.0:1787787389.654772:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1d96 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.654793:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1d96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.654828:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1d96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.654846:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc800/0xdeb1953cba4b1d9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.654853:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc800/0xdeb1953cba4b1d9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.654859:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc800/0xdeb1953cba4b1d9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.655199:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1da4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.655210:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1da4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.655217:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1da4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787787389.655265:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1da4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.655278:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1d96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.655285:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1d96 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.655292:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1d96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.655309:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fce00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787389.655314:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1d96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.655323:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1d96 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.655337:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:0.0:1787787389.655340:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787389.655346:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1d96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.655352:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fce00/0xdeb1953cba4b1d96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.655385:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc800/0xdeb1953cba4b1d9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.655391:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc800/0xdeb1953cba4b1d9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.655397:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc800/0xdeb1953cba4b1d9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.655402:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fc800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787389.655405:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc800/0xdeb1953cba4b1d9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.655412:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc800/0xdeb1953cba4b1d9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.655431:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d07096a0600) 00010000:00010000:0.0:1787787389.655434:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787389.655495:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc800/0xdeb1953cba4b1d9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.655503:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc800/0xdeb1953cba4b1d9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.655520:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1da4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.655526:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1da4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.655532:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1da4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.655537:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fde00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787389.655540:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1da4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.655546:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1da4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.655553:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07096a0100) 00010000:00010000:0.0:1787787389.655556:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787389.655559:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1da4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.655564:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1da4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787389.655668:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+32:11556:x1874630678759936:12345-192.168.206.10@tcp:34:lfs.0 Request processed in 989us (1283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787389.655677:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 194 00000100:00100000:0.0:1787787389.693899:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787389.693999:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678760192 00000100:00100000:3.0:1787787389.694009:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678760192 00000100:00100000:3.0:1787787389.694062:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 195 00000100:00100000:3.0:1787787389.694072:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0601f95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+32:11559:x1874630678760192:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787787389.694092:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787389.694112:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1dab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3535e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.694202:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1db2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.694217:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1db2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.694228:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1db2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.694244:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1db9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.694251:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1db9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.694258:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1db9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.694618:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1dc0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.694629:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.694636:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787389.694645:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787787389.694732:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1db2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.694740:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1db2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.694753:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1db2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.694759:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0700030800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787389.694763:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1db2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.694770:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1db2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.694782:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:3.0:1787787389.694785:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787389.694789:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1db2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.694796:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1db2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.694808:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1db9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.694814:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1db9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.694819:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1db9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.694824:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708770800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787389.694827:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1db9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.694843:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1db9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.694851:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d071b71d100) 00010000:00010000:3.0:1787787389.694854:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787389.694856:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1db9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.694862:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1db9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.694900:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1dab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3535e expref: 35 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.694913:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1dc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3535e expref: 34 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.694920:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07096a0100) 00010000:00010000:3.0:1787787389.694922:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787787389.694924:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708770200, rc 0) 00000100:00100000:3.0:1787787389.694985:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0601f95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+34:11559:x1874630678760192:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 913us (1094us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1787787389.694992:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 195 00000100:00100000:2.0:1787787389.702947:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787389.705790:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678760320 00000100:00100000:0.0:1787787389.705804:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678760320 00000100:00100000:0.0:1787787389.705878:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 196 00000100:00100000:0.0:1787787389.705888:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d060260f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+34:11559:x1874630678760320:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:0.0:1787787389.705954:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1dce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.705971:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1d73 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35349 expref: 34 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.705980:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1dce lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.706016:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1d73 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35349 expref: 34 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.706029:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1d73 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35349 expref: 34 pid: 9687 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787389.706043:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0601f943c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5821:1874630694478976:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787787389.706193:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0707822a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787787389.709514:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787389.709617:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678760576 00000100:00100000:3.0:1787787389.709626:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678760576 00000100:00100000:3.0:1787787389.709679:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 52 00000100:00100000:3.0:1787787389.709689:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+35:5580:x1874630678760576:12345-192.168.206.10@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787787389.710005:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+36:5580:x1874630678760576:12345-192.168.206.10@tcp:35:ldlm_bl.0 Request processed in 315us (500us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1787787389.710013:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 52 00000100:00100000:0.0:1787787389.710400:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0601f943c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5821:1874630694478976:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787787389.710434:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1dce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787389.715745:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787389.717847:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678760704 00000100:00100000:3.0:1787787389.717864:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678760704 00010000:00010000:3.0:1787787389.717927:0:8496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1d73 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35349 expref: 36 pid: 9687 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787389.718035:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 75 00000100:00100000:3.0:1787787389.718048:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705814450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+36:2345:x1874630678760704:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787389.718067:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787389.718076:0:8496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1d73 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35349 expref: 36 pid: 9687 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.718092:0:8496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1d73 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35349 expref: 36 pid: 9687 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.718119:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b1d73 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35349 expref: 36 pid: 9687 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.718140:0:8496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07096a0100) 00010000:00010000:3.0:1787787389.718147:0:8496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1dce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.718159:0:8496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1dce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.718169:0:8496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1dce lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.718229:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787389.718320:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705814450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+35:2345:x1874630678760704:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 273us (2587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787389.718329:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 75 00010000:00010000:1.0:1787787389.718465:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1dce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.718475:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1dce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.718526:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1dce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.718534:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1dce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.718542:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1dce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.718549:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fde00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787389.718554:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1dce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.718563:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1dce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.718574:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07096a0100) 00010000:00010000:1.0:1787787389.718577:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787787389.718581:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1dce lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.718588:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fde00/0xdeb1953cba4b1dce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787389.718634:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d060260f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+34:11559:x1874630678760320:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 12747us (15696us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787389.718643:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 196 00000100:00100000:1.0:1787787389.725192:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787389.726579:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678760960 00000100:00100000:3.0:1787787389.726595:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678760960 00000100:00100000:2.0:1787787389.726903:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 53 00000100:00100000:2.0:1787787389.726917:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+34:11559:x1874630678760960:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:2.0:1787787389.727254:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+35:11559:x1874630678760960:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 339us (2076us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1787787389.727263:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 53 00000100:00100000:2.0:1787787389.817962:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787389.818979:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678761216 00000100:00100000:1.0:1787787389.818995:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678761216 00000100:00100000:1.0:1787787389.819170:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 197 00000100:00100000:1.0:1787787389.819182:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d060260c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+35:11570:x1874630678761216:12345-192.168.206.10@tcp:101:cat.0 00010000:00010000:1.0:1787787389.819215:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787389.819245:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b1dd5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35365 expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.819341:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1ddc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.819358:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1ddc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.819384:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1ddc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.819401:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1de3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.819408:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1de3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.819414:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1de3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.819856:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b1dea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.819868:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b1dea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.819884:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b1dea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787389.819896:0:9687:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1787787389.820008:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1ddc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.820016:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1ddc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.820023:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1ddc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.820030:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1dc00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787389.820035:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1ddc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.820044:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1ddc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.820058:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:1.0:1787787389.820061:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787389.820066:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1ddc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.820072:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1ddc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.822601:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1de3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.822719:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1de3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.822764:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1de3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.822771:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1de00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787389.823138:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1de3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.823165:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1de3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.823188:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d07114ac200) 00010000:00010000:1.0:1787787389.823191:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787389.823197:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1de3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.823204:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1de3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787389.824030:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b1dd5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35365 expref: 38 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787389.824060:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b1dea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35365 expref: 37 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787389.824070:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07096a0100) 00010000:00010000:2.0:1787787389.824073:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787787389.824076:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1ce00, rc 0) 00000100:00100000:2.0:1787787389.824192:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d060260c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+37:11570:x1874630678761216:12345-192.168.206.10@tcp:101:cat.0 Request processed in 5010us (6242us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1787787389.824203:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 197 00000100:00100000:3.0:1787787389.830842:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787389.834319:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678761472 00000100:00100000:0.0:1787787389.834339:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678761472 00000100:00100000:0.0:1787787389.834526:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 54 00000100:00100000:0.0:1787787389.834538:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+37:11570:x1874630678761472:12345-192.168.206.10@tcp:35:cat.0 00000100:00100000:0.0:1787787389.834851:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+38:11570:x1874630678761472:12345-192.168.206.10@tcp:35:cat.0 Request processed in 314us (4021us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1787787389.834860:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 54 00000100:00100000:1.0:1787787389.858741:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787389.863537:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678761728 00000100:00100000:3.0:1787787389.863558:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678761728 00000100:00100000:3.0:1787787389.863643:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 198 00000100:00100000:3.0:1787787389.863654:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+38:11571:x1874630678761728:12345-192.168.206.10@tcp:36:rm.0 00010000:00010000:3.0:1787787389.863733:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787787389.863782:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b1dea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35365 expref: 38 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.863821:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770200/0xdeb1953cba4b1dc0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3535e expref: 37 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.863837:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1d88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35350 expref: 36 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.863966:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d07096a0100) 00010000:00010000:3.0:1787787389.863981:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787787389.864020:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1df8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.864275:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1df8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.864305:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1df8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.864323:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1dff lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.864331:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1dff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.864338:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1dff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.864751:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1e06 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.864760:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1e06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.864767:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1e06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787787389.868242:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:3.0:1787787389.868258:0:5820:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 302094819178ns, next at 303094814992ns, rc = 0 00010000:00010000:3.0:1787787389.868342:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1e0d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.868361:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1e0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.868386:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1e0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.868407:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1e0d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.868415:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1e0d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.868422:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1e0d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.868468:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787389.868499:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1e06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.868504:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1e06 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.868510:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1e06 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.868516:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0700031c00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787389.868521:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1e06 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.868528:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1e06 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.868541:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d071b71dc00) 00010000:00010000:3.0:1787787389.868544:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787787389.868549:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1e06 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.868565:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1e06 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.868591:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1df8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.868597:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1df8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.868602:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1df8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.868607:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708770800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787389.868610:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1df8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.868616:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1df8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.868625:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:3.0:1787787389.868628:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787389.868631:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1df8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.868636:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770800/0xdeb1953cba4b1df8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.868639:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00010000:3.0:1787787389.868648:0:5820:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008af2ef2e reply state 000000009b1b105b transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1dff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.868650:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1e0d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.868668:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0700030800 already unused, calling callback (ffffffffc14b1420) 00000100:00100000:3.0:1787787389.868671:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787787389.868673:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1e0d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.868684:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1e0d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.868696:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d071b71dc00) 00010000:00010000:0.0:1787787389.868700:0:8439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787787389.868703:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1e0d lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.868709:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1e0d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.868728:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787389.868738:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787389.868740:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787389.868800:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+37:11571:x1874630678761728:12345-192.168.206.10@tcp:36:rm.0 Request processed in 5143us (10066us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1787787389.868811:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 198 00010000:00010000:0.0:1787787389.874147:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1dff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.874170:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1dff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.874180:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1dff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.874187:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708770600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787389.874193:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1dff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.874203:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1dff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.874224:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d071b71d100) 00010000:00010000:0.0:1787787389.874228:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787389.874233:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1dff lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.874241:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770600/0xdeb1953cba4b1dff lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787389.905700:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787389.905962:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678761984 00000100:00100000:3.0:1787787389.905975:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678761984 00000100:00100000:2.0:1787787389.908718:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 199 00000100:00100000:2.0:1787787389.908754:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+36:11577:x1874630678761984:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:2.0:1787787389.908809:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787389.908839:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1e14 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3536c expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787389.909174:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1e1b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787389.909216:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1e1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787389.909230:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1e1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787389.909250:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1e22 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787389.909258:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1e22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787389.909265:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1e22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787787389.910243:0:9687:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1787787389.910496:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1e29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787389.910513:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1e29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787389.911645:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1e29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787389.911715:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1e1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787389.911723:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1e1b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787389.911731:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1e1b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787389.911752:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787389.911757:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1e1b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787389.912190:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1e1b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787389.912207:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:2.0:1787787389.912210:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787389.912216:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1e1b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787389.912223:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1e1b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787787389.912243:0:9687:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d3ad1f9 reply state 000000001211bae3 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1e22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787389.912252:0:9687:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787787389.912303:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1e14 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3536c expref: 39 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787389.912318:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1e29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3536c expref: 38 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787389.912326:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0d00) 00010000:00010000:2.0:1787787389.912329:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787787389.912331:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd38800, rc 0) 00000100:00100000:2.0:1787787389.912484:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+39:11577:x1874630678761984:12345-192.168.206.10@tcp:101:bash.0 Request processed in 3704us (6751us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787787389.912504:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 199 00010000:00010000:0.0:1787787389.914909:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1e22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.914929:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1e22 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.914938:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1e22 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.914963:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787389.914968:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1e22 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.914976:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1e22 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.914995:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d07078d0a00) 00010000:00010000:0.0:1787787389.914999:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787389.915004:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1e22 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787389.915021:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b1e22 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787389.929991:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787389.930217:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678762112 00000100:00100000:3.0:1787787389.930231:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678762112 00000100:00100000:3.0:1787787389.930310:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 60 00000100:00100000:3.0:1787787389.930321:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2343:x1874630678762112:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:3.0:1787787389.930345:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787389.930382:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1e37 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35373 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787787389.930415:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787787389.930480:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=302s v=(0 0) 00010000:00010000:3.0:1787787389.930485:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787389.930496:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1e37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35373 expref: 6 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.930520:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1e37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35373 expref: 6 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787389.930535:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0700031c00, rc 0) 00000100:00100000:3.0:1787787389.930610:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2343:x1874630678762112:12345-192.168.206.10@tcp:101:bash.0 Request processed in 290us (3859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787389.930617:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 60 00000100:00100000:1.0:1787787389.936347:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787389.936547:0:10776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678762240 00000100:00100000:2.0:1787787389.936559:0:10776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678762240 00000100:00100000:2.0:1787787389.936683:0:10776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 61 00000100:00100000:2.0:1787787389.936696:0:10776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+6:11577:x1874630678762240:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:2.0:1787787389.936721:0:10776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787389.936746:0:10776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030798ded/0xdeb1953cba4b1e3e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3537a expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787389.936802:0:10776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1e37 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35373 expref: 7 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787389.936813:0:10776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787389.936819:0:10776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787389.936825:0:10776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030798ded/0xdeb1953cba4b1e3e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3537a expref: 7 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787389.936868:0:10776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1e37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35373 expref: 7 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787389.936885:0:10776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1e37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35373 expref: 7 pid: 6673 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787389.936903:0:10776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d060260de00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10776:1874630694479104:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787787389.937025:0:10776:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07087599c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787389.949498:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787389.951427:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678762368 00000100:00100000:1.0:1787787389.951495:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678762368 00010000:00010000:1.0:1787787389.951560:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1e37 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35373 expref: 8 pid: 6673 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787389.951610:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 76 00000100:00100000:1.0:1787787389.951621:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0601f943c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+8:2344:x1874630678762368:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787787389.951659:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787389.951687:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1e37 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35373 expref: 8 pid: 6673 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.951703:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1e37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35373 expref: 8 pid: 6673 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.951733:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787389.951738:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787389.951749:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000030798ded/0xdeb1953cba4b1e3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3537a expref: 8 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.951782:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030798ded/0xdeb1953cba4b1e3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3537a expref: 8 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787389.951831:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000030798ded/0xdeb1953cba4b1e3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3537a expref: 8 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787389.951852:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07377e6580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5806:1874630694479232:192.168.206.10@tcp:105: 00000100:00100000:1.0:1787787389.951970:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0704e2f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787389.959507:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07377e6580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5806:1874630694479232:192.168.206.10@tcp:105: 00010000:00010000:3.0:1787787389.959563:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787389.959635:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0601f943c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+8:2344:x1874630678762368:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 8013us (10149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787389.959650:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 76 00010000:00010000:2.0:1787787389.959899:0:10776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1e37 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35373 expref: 7 pid: 6673 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787389.959923:0:10776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d060260de00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10776:1874630694479104:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787787389.959955:0:10776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000030798ded/0xdeb1953cba4b1e3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3537a expref: 6 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787389.959974:0:10776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd39800, rc 0) 00000100:00100000:3.0:1787787389.960467:0:10776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+6:11577:x1874630678762240:12345-192.168.206.10@tcp:101:bash.0 Request processed in 23769us (24130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787389.960476:0:10776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 61 00000100:00100000:1.0:1787787389.970059:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787389.970186:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678762624 00000100:00100000:2.0:1787787389.970198:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678762624 00000100:00100000:2.0:1787787389.970286:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 55 00000100:00100000:2.0:1787787389.970297:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+38:11577:x1874630678762624:12345-192.168.206.10@tcp:35:bash.0 00000100:00100000:3.0:1787787389.970910:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+39:11577:x1874630678762624:12345-192.168.206.10@tcp:35:bash.0 Request processed in 612us (862us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1787787389.970922:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 55 00000100:00100000:1.0:1787787390.165589:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787390.169947:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678762752 00000100:00100000:0.0:1787787390.169970:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678762752 00000100:00100000:0.0:1787787390.170089:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 200 00000100:00100000:0.0:1787787390.170103:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+39:11593:x1874630678762752:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787787390.170135:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787390.170162:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1e45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35381 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.170247:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1e4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.170265:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1e4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.170321:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1e4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787390.170423:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787787390.170428:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787787390.170475:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1e4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.170505:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1e45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35381 expref: 41 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.170527:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1e4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35381 expref: 40 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.170537:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:0.0:1787787390.170540:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787787390.170544:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d07059fc600, rc 0) 00000100:00100000:0.0:1787787390.170635:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+40:11593:x1874630678762752:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 536us (5060us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787390.170643:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 200 00000100:00100000:1.0:1787787390.175584:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787390.176645:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678763008 00000100:00100000:3.0:1787787390.176663:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678763008 00000100:00100000:3.0:1787787390.178172:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 201 00000100:00100000:3.0:1787787390.178207:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+40:11593:x1874630678763008:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787787390.178239:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787390.178268:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1e53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35388 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.178435:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1e5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.178607:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.178623:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787390.178638:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787787390.179109:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1e53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35388 expref: 43 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.179134:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1e5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35388 expref: 42 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.179144:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0d00) 00010000:00010000:3.0:1787787390.179147:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787787390.179151:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0700031c00, rc 0) 00000100:00100000:3.0:1787787390.179248:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+42:11593:x1874630678763008:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 1059us (3677us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1787787390.179258:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 201 00000100:00100000:1.0:1787787390.185058:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787390.185105:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787390.185777:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678763392 00000100:00100000:3.0:1787787390.185793:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678763392 00000100:00100000:0.0:1787787390.185825:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678763264 00000100:00100000:0.0:1787787390.185837:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678763264 00000100:00100000:3.0:1787787390.185878:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:3.0:1787787390.185890:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+43:2345:x1874630678763392:12345-192.168.206.10@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787787390.185908:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 202 00000100:00100000:0.0:1787787390.185920:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+43:11593:x1874630678763264:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787787390.185951:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787390.185975:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1e68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3538f expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.186138:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1e6f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.186156:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1e6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.186170:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1e6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.186183:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00200000:0.0:1787787390.186186:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787787390.186216:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031c00/0xdeb1953cba4b1e5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35388 expref: 44 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.186326:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0d00) 00010000:00010000:3.0:1787787390.186332:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787787390.186380:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1e68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3538f expref: 45 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.186402:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1e6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3538f expref: 44 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.186411:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0d00) 00010000:00010000:0.0:1787787390.186416:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787787390.186420:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d07059fd400, rc 0) 00000100:00100000:3.0:1787787390.186475:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+44:2345:x1874630678763392:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 585us (1365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787390.186486:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:0.0:1787787390.186503:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+43:11593:x1874630678763264:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 583us (1457us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1787787390.186513:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 202 00000100:00100000:1.0:1787787390.199798:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787390.200133:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678763520 00000100:00100000:3.0:1787787390.200143:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678763520 00000100:00100000:3.0:1787787390.200231:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 62 00000100:00080000:0.0:1787787390.200523:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787787390.200615:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+6:2342:x1874630678763520:12345-192.168.206.10@tcp:1:lfs.0 00010000:00010000:3.0:1787787390.200659:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1e7d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.200679:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000030798ded/0xdeb1953cba4b1e3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3537a expref: 6 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.200688:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787390.200692:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787787390.200698:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1e7d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.200740:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000030798ded/0xdeb1953cba4b1e3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3537a expref: 6 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.200755:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000030798ded/0xdeb1953cba4b1e3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3537a expref: 6 pid: 10776 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787390.200771:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06032ed2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6673:1874630694479360:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787787390.200912:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073fd9a780 going to sleep for 11 seconds 00000100:00100000:1.0:1787787390.204330:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787390.204660:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06032ed2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6673:1874630694479360:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787787390.204684:0:6673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1e7d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787390.205362:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678763648 00000100:00100000:2.0:1787787390.205427:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678763648 00002000:00100000:2.0:1787787390.205567:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9d07377e61c0 x1874630678763648/t0(0) o4->c5599457-aa74-4a71-951f-faabe33e6ec7@192.168.206.10@tcp:251/0 lens 504/0 e 0 to 0 dl 1787787401 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787787390.205577:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d07377e61c0 with x1874630678763648 ext(0->8) 00010000:00010000:2.0:1787787390.205585:0:6679:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000030798ded/0xdeb1953cba4b1e3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3537a expref: 7 pid: 10776 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.205599:0:6679:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000030798ded/0xdeb1953cba4b1e3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3537a expref: 7 pid: 10776 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787787390.205606:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d07377e61c0 00000100:00100000:2.0:1787787390.205636:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 3 00000100:00100000:2.0:1787787390.205645:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2344:x1874630678763648:12345-192.168.206.10@tcp:4:lfs.0 00000100:00100000:2.0:1787787390.206856:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+9:2344:x1874630678763648:12345-192.168.206.10@tcp:4:lfs.0 Request processed in 1204us (2527us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787787390.206868:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 3 00002000:00100000:2.0:1787787390.206878:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9d07377e61c0 x1874630678763648/t4294967308(0) o4->c5599457-aa74-4a71-951f-faabe33e6ec7@192.168.206.10@tcp:251/0 lens 504/448 e 0 to 0 dl 1787787401 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787787390.206905:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d07377e61c0 with x1874630678763648 ext(0->8) 00010000:00010000:2.0:1787787390.206914:0:6679:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000030798ded/0xdeb1953cba4b1e3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3537a expref: 9 pid: 10776 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.206930:0:6679:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000030798ded/0xdeb1953cba4b1e3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3537a expref: 9 pid: 10776 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787787390.206938:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d07377e61c0 00000100:00100000:1.0:1787787390.211334:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787390.211474:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678763776 00000100:00100000:0.0:1787787390.211484:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678763776 00010000:00010000:0.0:1787787390.211525:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000030798ded/0xdeb1953cba4b1e3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3537a expref: 9 pid: 10776 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787390.211584:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 77 00000100:00100000:0.0:1787787390.211595:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+9:2342:x1874630678763776:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787390.211610:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787787390.211628:0:5805:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787787390.211631:0:5805:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787787389 00002000:00010000:0.0:1787787390.211634:0:5805:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787787389 00002000:00010000:0.0:1787787390.211636:0:5805:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787787389 00010000:00010000:0.0:1787787390.211642:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000030798ded/0xdeb1953cba4b1e3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3537a expref: 9 pid: 10776 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.211654:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000030798ded/0xdeb1953cba4b1e3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3537a expref: 9 pid: 10776 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.211674:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030798ded/0xdeb1953cba4b1e3e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3537a expref: 9 pid: 10776 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.211692:0:5805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787787390.211696:0:5805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787787390.211701:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1e7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.211710:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1e7d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.212710:0:6673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1e7d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.212737:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1e7d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.212812:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1e7d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.212823:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1e7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.212831:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1e7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.212838:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0700031c00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:2.0:1787787390.212843:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1e7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.212863:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1e7d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.212878:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1e7d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787390.212964:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+8:2342:x1874630678763520:12345-192.168.206.10@tcp:1:lfs.0 Request processed in 12723us (13173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787390.212973:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 62 00010000:00010000:0.0:1787787390.213362:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1e7d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.213409:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787390.213434:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2342:x1874630678763776:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 1842us (2107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787390.213463:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 77 00000100:00100000:1.0:1787787390.221594:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787390.221816:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678764032 00000100:00100000:3.0:1787787390.221826:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678764032 00000100:00100000:3.0:1787787390.221895:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 56 00000100:00100000:3.0:1787787390.221916:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703167c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+43:11593:x1874630678764032:12345-192.168.206.10@tcp:35:lfs.0 00000004:00010000:3.0:1787787390.221977:0:5822:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1e6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3538f expref: 43 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787787390.222211:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1787787390.222252:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1787787390.222618:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1787787390.222671:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1e84 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.222687:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1e29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3536c expref: 47 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.222696:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1e84 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.222726:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1e29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3536c expref: 47 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.222741:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1e29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3536c expref: 47 pid: 9687 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787390.222777:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06032ed2c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5822:1874630694479488:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787787390.222850:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073fd9a180 going to sleep for 11 seconds 00000100:00100000:1.0:1787787390.228097:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06032ed2c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5822:1874630694479488:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787787390.228126:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1e84 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787390.229765:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787390.230223:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678764160 00000100:00100000:3.0:1787787390.230232:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678764160 00010000:00010000:3.0:1787787390.230270:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1e29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3536c expref: 48 pid: 9687 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787390.230311:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 78 00000100:00100000:3.0:1787787390.230320:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+48:2344:x1874630678764160:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787390.230333:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787390.230340:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1e29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3536c expref: 48 pid: 9687 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.230352:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1e29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3536c expref: 48 pid: 9687 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.230384:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1e29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3536c expref: 48 pid: 9687 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.230399:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0d00) 00010000:00010000:3.0:1787787390.230405:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1e84 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.230414:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1e84 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.230540:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1e84 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.230875:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787390.230946:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+47:2344:x1874630678764160:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 625us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787390.230955:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 78 00010000:00010000:1.0:1787787390.239895:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1e84 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.239921:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1e84 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787787390.240075:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1787787390.240288:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1787787390.240425:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07377e4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5822:1874630694479616:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787787390.240511:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787390.240577:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694479616 00000100:00100000:3.0:1787787390.240594:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694479616 00000100:00100000:3.0:1787787390.240669:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1787787390.240678:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787787390.240681:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5822:x1874630694479616:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787787390.240752:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0704e2f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787390.240792:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5822:x1874630694479616:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 114us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787390.240801:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787787390.240951:0:5822:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:3.0:1787787390.240957:0:5822:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:3.0:1787787390.240973:0:5822:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d070303f0c0, transno 4294967307 00000100:00100000:3.0:1787787390.240992:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07377e4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5822:1874630694479616:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787787390.246210:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1787787390.246302:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d060260de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5822:1874630694479744:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787787390.246387:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787390.246423:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0708759600 going to sleep for 11 seconds 00000100:00100000:0.0:1787787390.246651:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694479744 00000100:00100000:0.0:1787787390.246658:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694479744 00000100:00100000:0.0:1787787390.246780:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787787390.246790:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d060260cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5822:x1874630694479744:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787787390.247030:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d060260cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5822:x1874630694479744:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 241us (643us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787787390.247038:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787787390.248759:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d060260de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5822:1874630694479744:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787787390.249105:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1787787390.249166:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1e84 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.249177:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1e84 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.249184:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1e84 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.249190:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0700030800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787390.249195:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1e84 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.249202:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1e84 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.249229:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0d00) 00010000:00010000:3.0:1787787390.249233:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787787390.249237:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1e84 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.249244:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1e84 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787787390.249570:0:5822:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787787390.249736:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1787787390.249747:0:5822:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 302476307854ns, next at 303476305778ns, rc = 0 00000001:00080000:3.0:1787787390.249754:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1787787390.249788:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0d00) 00010000:00010000:3.0:1787787390.249792:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787787390.249799:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd400/0xdeb1953cba4b1e6f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3538f expref: 51 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787390.251287:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703167c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+50:11593:x1874630678764032:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 29366us (29704us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1787787390.251300:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 56 00000020:00080000:3.0:1787787390.251307:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787787390.257078:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787390.257261:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678764288 00000100:00100000:2.0:1787787390.257269:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678764288 00000100:00100000:2.0:1787787390.257382:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 203 00000100:00100000:2.0:1787787390.257393:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+50:11593:x1874630678764288:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787787390.257430:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787390.257483:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1e8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35396 expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.257553:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1e8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35396 expref: 51 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.257573:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1e8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35396 expref: 51 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.257591:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0300) 00010000:00010000:2.0:1787787390.257593:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787787390.257597:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd39200, rc 0) 00000100:00100000:2.0:1787787390.257647:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+51:11593:x1874630678764288:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 256us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787390.257654:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 203 00000100:00100000:1.0:1787787390.264872:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787390.265847:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678764544 00000100:00100000:0.0:1787787390.265860:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678764544 00000100:00100000:0.0:1787787390.265925:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 57 00000100:00100000:0.0:1787787390.265935:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+51:11593:x1874630678764544:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:0.0:1787787390.266181:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+52:11593:x1874630678764544:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 246us (1318us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1787787390.266189:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 57 00000100:00100000:2.0:1787787390.338380:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d060260c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694480256:0@lo:400:kworker.0 00000100:00100000:3.0:1787787390.338486:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d060260fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694480128:0@lo:400:kworker.0 00000100:00100000:2.0:1787787390.338500:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787390.338570:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787390.338635:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d060260f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694479872:0@lo:400:kworker.0 00000100:00100000:1.0:1787787390.338723:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d060260da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874630694480000:0@lo:400:kworker.0 00000100:00100000:1.0:1787787390.338759:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787390.338810:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694480128 00000100:00100000:1.0:1787787390.338817:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694480128 00000100:00100000:0.0:1787787390.339574:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787390.339645:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694480256 00000100:00100000:2.0:1787787390.339651:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694480256 00000100:00100000:2.0:1787787390.339688:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787787390.339697:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d060260ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3292:x1874630694480256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787390.339750:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d060260ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3292:x1874630694480256:12345-0@lo:400:kworker.0 Request processed in 53us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787390.339756:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787787390.339793:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d060260c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694480256:0@lo:400:kworker.0 00000100:00100000:1.0:1787787390.342624:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694480000 00000100:00100000:2.0:1787787390.342686:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787787390.342740:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694480128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787390.342833:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694480128:12345-0@lo:400:kworker.0 Request processed in 137us (4263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787390.342839:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787787390.342893:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d060260fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694480128:0@lo:400:kworker.0 00000100:00100000:0.0:1787787390.343015:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d060260e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1874630694480384:0@lo:400:kworker.0 00000100:00100000:0.0:1787787390.343050:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787787390.343094:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787787390.343099:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787390.343300:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694480384 00000100:00100000:2.0:1787787390.343306:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694480384 00000100:00100000:2.0:1787787390.343351:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787787390.343359:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0601f94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874630694480384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787390.343406:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0601f94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874630694480384:12345-0@lo:400:kworker.0 Request processed in 48us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787390.343412:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787787390.343457:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694479872 00000100:00100000:2.0:1787787390.343461:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694479872 00000100:00100000:2.0:1787787390.343541:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1787787390.343548:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3293:x1874630694479872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787390.343584:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3293:x1874630694479872:12345-0@lo:400:kworker.0 Request processed in 34us (4010us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787390.343590:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1787787390.343684:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694480000 00000100:00100000:1.0:1787787390.343716:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787787390.343722:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874630694480000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787390.343780:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874630694480000:12345-0@lo:400:kworker.0 Request processed in 56us (5019us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787390.343789:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787787390.343825:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d060260da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874630694480000:0@lo:400:kworker.0 00000100:00100000:3.0:1787787390.344205:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787390.345050:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678764672 00000100:00100000:2.0:1787787390.345060:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678764672 00000100:00100000:2.0:1787787390.345111:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 204 00000100:00100000:2.0:1787787390.345119:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+52:11603:x1874630678764672:12345-192.168.206.10@tcp:34:lfs.0 00010000:00010000:2.0:1787787390.345181:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1e92 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.345209:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1e92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.345222:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1e92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.345238:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1e99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.345245:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1e99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.345252:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1e99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.345345:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1ea0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.345354:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.345361:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787787390.345412:0:9687:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.345424:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1e92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.345431:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1e92 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.345492:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1e92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.345498:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39e00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787390.345502:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1e92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.345508:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1e92 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.345520:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:2.0:1787787390.345523:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787390.345527:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1e92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.345537:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1e92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.345550:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1e99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.345557:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1e99 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.345562:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1e99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.345567:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd38800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787390.345569:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1e99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.345586:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1e99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.345594:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d07078d0400) 00010000:00010000:2.0:1787787390.345597:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787390.345600:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1e99 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.345605:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1e99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.345619:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.345626:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1ea0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.345631:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.345636:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787390.345639:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.345645:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1ea0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.345651:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0300) 00010000:00010000:2.0:1787787390.345653:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787390.345656:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1ea0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.345671:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b1ea0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787390.345736:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+52:11603:x1874630678764672:12345-192.168.206.10@tcp:34:lfs.0 Request processed in 618us (1539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787390.345745:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 204 00000100:00080000:0.0:1787787390.345912:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787390.345942:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d060260f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694479872:0@lo:400:kworker.0 00000100:00100000:0.0:1787787390.345956:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d060260e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1874630694480384:0@lo:400:kworker.0 00000100:00100000:2.0:1787787390.399827:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787390.400771:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678764928 00000100:00100000:1.0:1787787390.400786:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678764928 00000100:00100000:1.0:1787787390.400860:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 205 00000100:00100000:1.0:1787787390.400878:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d060260fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+52:11606:x1874630678764928:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787787390.400901:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787390.400921:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d200/0xdeb1953cba4b1ea7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3539d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.400985:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1eae lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.400999:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1eae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.401011:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1eae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.401024:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1eb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.401031:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.401037:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.401171:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1ebc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.401180:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1ebc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.401187:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1ebc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787390.401197:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787787390.401291:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1eae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.401298:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1eae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.401305:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1eae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.401310:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1da00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787390.401315:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1eae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.401322:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1eae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.401334:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:1.0:1787787390.401337:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787390.401341:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1eae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.401357:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1eae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.401383:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.401389:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1eb5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.401638:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.401646:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1c600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787390.401650:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.401657:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1eb5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.401666:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d07114ac200) 00010000:00010000:1.0:1787787390.401669:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787390.401673:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1eb5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.401679:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1eb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.401721:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d200/0xdeb1953cba4b1ea7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3539d expref: 55 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.401734:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1ebc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3539d expref: 54 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.401750:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0300) 00010000:00010000:1.0:1787787390.401752:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787787390.401755:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1c800, rc 0) 00000100:00100000:1.0:1787787390.401975:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d060260fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+54:11606:x1874630678764928:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 1105us (2161us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1787787390.401983:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 205 00000100:00100000:3.0:1787787390.405816:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787390.405970:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678765056 00000100:00100000:2.0:1787787390.405983:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678765056 00000100:00100000:2.0:1787787390.406042:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 206 00000100:00100000:2.0:1787787390.406052:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+54:11606:x1874630678765056:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:2.0:1787787390.406115:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1eca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.406130:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1eca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.406140:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1eca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.406164:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1eca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.406171:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1eca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.406177:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1eca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.406181:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd38800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787390.406199:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1eca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.406206:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1eca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.406217:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0300) 00010000:00010000:2.0:1787787390.406220:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787787390.406224:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1eca lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.406230:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38800/0xdeb1953cba4b1eca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787390.406314:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+54:11606:x1874630678765056:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 263us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787390.406322:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 206 00000100:00100000:3.0:1787787390.416282:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787390.416486:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678765312 00000100:00100000:0.0:1787787390.416499:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678765312 00000100:00100000:0.0:1787787390.416620:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 58 00000100:00100000:0.0:1787787390.416633:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+54:11606:x1874630678765312:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:0.0:1787787390.416967:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+55:11606:x1874630678765312:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 336us (699us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1787787390.416976:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 58 00000100:00100000:3.0:1787787390.491913:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787390.492304:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678765568 00000100:00100000:0.0:1787787390.492317:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678765568 00000100:00100000:0.0:1787787390.492405:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 207 00000100:00100000:0.0:1787787390.492416:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+55:11617:x1874630678765568:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:0.0:1787787390.492555:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787390.492559:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787787390.492593:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1e4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35381 expref: 55 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.492624:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:0.0:1787787390.492630:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787787390.492645:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1ed1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c353a4 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.492766:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1ed8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.495420:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1ebc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3539d expref: 55 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.495454:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1ed8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.495520:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1ebc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3539d expref: 55 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.495539:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1ebc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3539d expref: 55 pid: 5821 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787390.495559:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0601f96580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5819:1874630694480512:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787787390.495700:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0707822a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787787390.499417:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0601f96580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5819:1874630694480512:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787787390.499479:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1ed8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787390.501913:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787390.502516:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678765696 00000100:00100000:1.0:1787787390.502530:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678765696 00010000:00010000:1.0:1787787390.502586:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1ebc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3539d expref: 56 pid: 5821 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787390.502681:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 79 00000100:00100000:1.0:1787787390.502693:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032ede00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+56:2345:x1874630678765696:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787787390.502725:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787390.502733:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1ebc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3539d expref: 56 pid: 5821 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.502749:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1ebc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3539d expref: 56 pid: 5821 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.502778:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1ebc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3539d expref: 56 pid: 5821 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.502798:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0300) 00010000:00010000:1.0:1787787390.503224:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1ed8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.503253:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1ed8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.503262:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1ed8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.503304:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787390.503504:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032ede00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+55:2345:x1874630678765696:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 810us (1599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787390.503514:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 79 00010000:00010000:3.0:1787787390.503676:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1ed8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.503685:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1ed8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787390.503721:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787787390.503937:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1ed1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353a4 expref: 56 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.503957:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1ed8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353a4 expref: 55 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.503966:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0300) 00010000:00010000:3.0:1787787390.503968:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787787390.503971:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d07059fc400, rc 0) 00000100:00100000:3.0:1787787390.504005:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+55:11617:x1874630678765568:12345-192.168.206.10@tcp:101:bash.0 Request processed in 11592us (12118us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1787787390.504026:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 207 00000100:00100000:1.0:1787787390.508964:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787390.509349:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678765952 00000100:00100000:2.0:1787787390.509375:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678765952 00000100:00100000:2.0:1787787390.509483:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 208 00000100:00100000:2.0:1787787390.509496:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+55:11617:x1874630678765952:12345-192.168.206.10@tcp:36:bash.0 00010000:00010000:2.0:1787787390.510234:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1ee6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.510257:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1ee6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.510272:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1ee6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787787390.511124:0:9687:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1787787390.511208:0:9687:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005cda303a reply state 000000006eddd587 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1ee6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787390.511220:0:9687:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787787390.511384:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+58:11617:x1874630678765952:12345-192.168.206.10@tcp:36:bash.0 Request processed in 1886us (2429us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1787787390.511394:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 208 00000020:00080000:2.0:1787787390.511401:0:9687:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787787390.514728:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1ee6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.514752:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1ee6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.514769:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1ee6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.514776:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39e00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787390.514795:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1ee6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.514805:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1ee6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.514825:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0300) 00010000:00010000:0.0:1787787390.514829:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787390.514835:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1ee6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.514843:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b1ee6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787390.515298:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787390.515822:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678766080 00000100:00100000:1.0:1787787390.515838:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678766080 00000100:00100000:1.0:1787787390.516019:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 209 00000100:00100000:1.0:1787787390.516031:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d060260c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+57:11617:x1874630678766080:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:1.0:1787787390.516062:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787390.516085:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1eed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c353ab expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.516209:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1ef4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.516225:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1ed8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353a4 expref: 58 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.516234:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1ef4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.516273:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1ed8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353a4 expref: 58 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.516295:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1ed8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353a4 expref: 58 pid: 5819 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787390.516312:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07377e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5821:1874630694480640:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787787390.516577:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0704e2fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787787390.519141:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787390.519275:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07377e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5821:1874630694480640:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787787390.519310:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1ef4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787390.519404:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678766208 00000100:00100000:2.0:1787787390.519413:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678766208 00010000:00010000:2.0:1787787390.519635:0:8496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1ed8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353a4 expref: 59 pid: 5819 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787390.519683:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 80 00000100:00100000:2.0:1787787390.519694:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032ca940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+59:2345:x1874630678766208:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787390.519713:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787390.519720:0:8496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1ed8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353a4 expref: 59 pid: 5819 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.519734:0:8496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1ed8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353a4 expref: 59 pid: 5819 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.519772:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1ed8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353a4 expref: 59 pid: 5819 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.519800:0:8496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0300) 00010000:00010000:2.0:1787787390.519806:0:8496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1ef4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.519834:0:8496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.519844:0:8496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1ef4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.519874:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787390.519936:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032ca940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+58:2345:x1874630678766208:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 244us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787390.519944:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 80 00010000:00010000:1.0:1787787390.520532:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.520545:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787390.520604:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787787390.520610:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787787390.520635:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.520674:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1eed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353ab expref: 58 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.520692:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1ef4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353ab expref: 57 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.520701:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0300) 00010000:00010000:1.0:1787787390.520714:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787787390.520717:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1c600, rc 0) 00000100:00100000:1.0:1787787390.520784:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d060260c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+57:11617:x1874630678766080:12345-192.168.206.10@tcp:101:bash.0 Request processed in 4753us (5491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787390.520793:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 209 00000100:00100000:3.0:1787787390.524090:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787390.524299:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678766464 00000100:00100000:2.0:1787787390.524312:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678766464 00000100:00100000:2.0:1787787390.524398:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 59 00000100:00100000:2.0:1787787390.524410:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+57:11617:x1874630678766464:12345-192.168.206.10@tcp:35:bash.0 00000100:00100000:2.0:1787787390.524711:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+58:11617:x1874630678766464:12345-192.168.206.10@tcp:35:bash.0 Request processed in 302us (632us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1787787390.524720:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 59 00000100:00100000:2.0:1787787390.587903:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787390.588170:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678766592 00000100:00100000:1.0:1787787390.588183:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678766592 00000100:00100000:1.0:1787787390.588257:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 210 00000100:00100000:1.0:1787787390.588268:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d060260e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+58:11623:x1874630678766592:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787787390.588299:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787390.588328:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1efb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c353b2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.588419:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1f02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.588475:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.588489:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787390.588566:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787787390.588571:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787787390.588597:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.588628:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1efb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353b2 expref: 60 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.588675:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1f02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353b2 expref: 59 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.588685:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:1.0:1787787390.588689:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787787390.588693:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1da00, rc 0) 00000100:00100000:1.0:1787787390.588775:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d060260e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+59:11623:x1874630678766592:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 508us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787390.588783:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 210 00010000:00010000:1.0:1787787390.589164:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787390.592729:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787390.592865:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678766720 00000100:00100000:0.0:1787787390.592878:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678766720 00000100:00100000:0.0:1787787390.592952:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 211 00000100:00100000:0.0:1787787390.592963:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+59:11623:x1874630678766720:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787787390.592987:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787390.593023:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1f09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c353b9 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.593102:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1f10 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.593120:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1f10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.593132:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1f10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.593148:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1f17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.593174:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.593181:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.593305:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1f1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.593316:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.593323:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787390.593377:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787787390.593383:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787787390.593406:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.593420:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.593429:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1f10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.593435:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1f10 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.593490:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1f10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.593508:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fcc00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787390.593513:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1f10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.593522:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1f10 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.593536:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:0.0:1787787390.593539:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787390.593544:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1f10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.593551:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fcc00/0xdeb1953cba4b1f10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.593574:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.593581:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1f17 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.593587:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1f17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.593593:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fc400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787390.593596:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1f17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.593602:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1f17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.593621:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d07096a0600) 00010000:00010000:0.0:1787787390.593623:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787390.593626:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1f17 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.593632:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1f17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.593669:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc600/0xdeb1953cba4b1f09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353b9 expref: 61 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.593685:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1f1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353b9 expref: 60 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.593693:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0300) 00010000:00010000:0.0:1787787390.593695:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787787390.593698:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d07059fdc00, rc 0) 00000100:00100000:0.0:1787787390.593768:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+60:11623:x1874630678766720:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 807us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787390.593777:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 211 00000100:00100000:3.0:1787787390.598918:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787390.598981:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787390.599124:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678766976 00000100:00100000:1.0:1787787390.599136:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678766976 00000100:00100000:1.0:1787787390.599210:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 212 00000100:00100000:1.0:1787787390.599222:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+60:11623:x1874630678766976:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787787390.599249:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787390.599276:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1f25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c353c0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.599417:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1f2c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.599434:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1ef4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353ab expref: 61 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.599488:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1f1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353b9 expref: 61 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.599520:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1f2c lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.599568:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1f1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353b9 expref: 61 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.599584:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1f1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353b9 expref: 61 pid: 5819 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787390.599600:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07377e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1874630694480768:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787787390.599717:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1ef4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353ab expref: 61 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.599727:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1ef4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353ab expref: 61 pid: 5821 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787390.599736:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07377e6580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1874630694480896:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787787390.599763:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0704e2fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787787390.599933:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678767104 00000100:00100000:0.0:1787787390.599939:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678767104 00010000:00010000:0.0:1787787390.599969:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1f1e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353b9 expref: 62 pid: 5819 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787390.599992:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 81 00000100:00100000:0.0:1787787390.600001:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705815450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+62:2345:x1874630678767104:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787390.600037:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787390.600044:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1f1e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353b9 expref: 62 pid: 5819 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.600057:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1f1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353b9 expref: 62 pid: 5819 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.600079:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0300) 00010000:00010000:0.0:1787787390.600085:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1f2c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.600092:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1f2c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.600099:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787390.600131:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705815450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+62:2345:x1874630678767104:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 131us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787390.600140:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 81 00010000:00010000:1.0:1787787390.603164:0:5820:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.10@tcp) returned -22 from blocking AST (req@000000008035768e x1874630694480768) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1f1e lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353b9 expref: 61 pid: 5819 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.603195:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fdc00/0xdeb1953cba4b1f1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353b9 expref: 61 pid: 5819 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787390.603216:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07377e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1874630694480768:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787787390.604080:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787390.604169:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678767232 00000100:00100000:2.0:1787787390.604179:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678767232 00010000:00010000:2.0:1787787390.604227:0:8496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1ef4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353ab expref: 61 pid: 5821 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787390.604272:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 82 00000100:00100000:2.0:1787787390.604282:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+61:2345:x1874630678767232:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787390.604300:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787390.604318:0:8496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1ef4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353ab expref: 61 pid: 5821 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.604332:0:8496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1ef4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353ab expref: 61 pid: 5821 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.604359:0:8496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0300) 00010000:00010000:2.0:1787787390.604374:0:8496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1f2c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.604385:0:8496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1f2c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.604394:0:8496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1f2c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.604418:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787390.604519:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+61:2345:x1874630678767232:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 238us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787390.604527:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 82 00010000:00010000:1.0:1787787390.605160:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1ef4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353ab expref: 60 pid: 5821 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787390.605180:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07377e6580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1874630694480896:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787787390.605206:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0300) 00010000:00010000:1.0:1787787390.605214:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1f2c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.605225:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1f2c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.605232:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1f2c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787390.605255:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787787390.605470:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1f25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353c0 expref: 61 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.605487:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1f2c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353c0 expref: 60 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.605496:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0300) 00010000:00010000:1.0:1787787390.605499:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787787390.605502:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1dc00, rc 0) 00000100:00100000:1.0:1787787390.605603:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+60:11623:x1874630678766976:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 6382us (6698us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1787787390.605612:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 212 00000100:00100000:3.0:1787787390.609651:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787390.609817:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678767488 00000100:00100000:0.0:1787787390.609831:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678767488 00000100:00100000:0.0:1787787390.609910:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:0.0:1787787390.609924:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06023ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+60:11623:x1874630678767488:12345-192.168.206.10@tcp:103:lfs.0 00010000:00010000:0.0:1787787390.609945:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787390.609977:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39200/0xdeb1953cba4b1e8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35396 expref: 60 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.610001:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0300) 00010000:00010000:0.0:1787787390.610025:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787390.610099:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06023ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+59:11623:x1874630678767488:12345-192.168.206.10@tcp:103:lfs.0 Request processed in 179us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787390.610108:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:2.0:1787787390.612815:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787390.612894:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678767616 00000100:00100000:0.0:1787787390.612905:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678767616 00000100:00100000:0.0:1787787390.612971:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 213 00000100:00100000:0.0:1787787390.612982:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d060260f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+59:11623:x1874630678767616:12345-192.168.206.10@tcp:58:lfs.0 00010000:00010000:0.0:1787787390.613150:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1f3a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.613171:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1f3a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.613185:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1f3a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787787390.613431:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1787787390.613630:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d060260f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+59:11623:x1874630678767616:12345-192.168.206.10@tcp:58:lfs.0 Request processed in 647us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787390.613640:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 213 00000100:00100000:2.0:1787787390.616349:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787390.616425:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678767744 00000100:00100000:3.0:1787787390.616464:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678767744 00000100:00100000:3.0:1787787390.616547:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 214 00000100:00100000:3.0:1787787390.616559:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d060260da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+59:11623:x1874630678767744:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787787390.616586:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787390.616611:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1f41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c353c7 expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.616688:0:9687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1f3a lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.616700:0:9687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1f41 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353c7 expref: 60 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.616722:0:9687:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1f3a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.616736:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1f41 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353c7 expref: 60 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.616761:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0300) 00010000:00010000:3.0:1787787390.616764:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787787390.616768:0:9687:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1f41 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353c7 expref: 60 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.616777:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0700030800, rc 0) 00000100:00100000:3.0:1787787390.619461:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d060260da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+60:11623:x1874630678767744:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 2878us (3098us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787390.619478:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 214 00000040:00080000:3.0:1787787390.654999:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787787390.655026:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787787390.655073:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1787787390.655081:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787787390.655237:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06023cf0c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874630694481024:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787787390.655383:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073fd9a840 going to sleep for 11 seconds 00000100:00100000:3.0:1787787390.662960:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787390.663291:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06023cf0c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874630694481024:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787787390.663624:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678767872 00000100:00100000:0.0:1787787390.663632:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678767872 00000100:00100000:0.0:1787787390.663696:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 215 00000100:00100000:0.0:1787787390.663709:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06023cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+60:11624:x1874630678767872:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787787390.663973:0:5819:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787787390.664300:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06023cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+60:11624:x1874630678767872:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 592us (1352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787390.664330:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 215 00000100:00100000:0.0:1787787390.667725:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787390.667838:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678768000 00000100:00100000:1.0:1787787390.667878:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678768000 00000100:00100000:1.0:1787787390.667947:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 216 00000100:00100000:1.0:1787787390.667960:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0601f943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+60:11624:x1874630678768000:12345-192.168.206.10@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787787390.668064:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1f48 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.668084:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1f48 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.668095:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1f48 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.668113:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1f4f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.668120:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1f4f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.668126:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1f4f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.668152:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b1f56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.668160:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b1f56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.668166:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b1f56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787390.668213:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787787390.668218:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787787390.668240:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b1f56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.668253:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1f48 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.668261:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1f48 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.668268:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1f48 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.668275:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1c800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787390.668279:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1f48 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.668287:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1f48 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.668301:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d071b71da00) 00010000:00010000:1.0:1787787390.668304:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787390.668309:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1f48 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.668316:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1f48 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.668331:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1f4f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.668338:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1f4f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.668344:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1f4f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.668356:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1c600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787390.668359:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1f4f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.668376:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1f4f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.668385:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9d07114ac200) 00010000:00010000:1.0:1787787390.668387:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787390.668390:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1f4f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.668396:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1f4f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.668412:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b1f56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.668419:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b1f56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.668424:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b1f56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.668430:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1ce00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787390.668433:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b1f56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.668501:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b1f56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.668521:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0300) 00010000:00010000:1.0:1787787390.668523:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787390.668527:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b1f56 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.668533:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b1f56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787390.668635:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0601f943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+60:11624:x1874630678768000:12345-192.168.206.10@tcp:34:lhsmtool_posix.0 Request processed in 674us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787390.668644:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 216 00000100:00100000:2.0:1787787390.672708:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787390.674082:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678768256 00000100:00100000:1.0:1787787390.674099:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678768256 00000100:00100000:1.0:1787787390.674186:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 217 00000100:00100000:1.0:1787787390.674199:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0602efb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+60:11624:x1874630678768256:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787787390.674227:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787390.674253:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1f5d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c353ce expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.674394:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b1f64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.674412:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b1f64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.674426:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b1f64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787390.674457:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787787390.674600:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b1f64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.674608:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b1f64 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.674615:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b1f64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.674621:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1d800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787390.674625:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b1f64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.674633:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b1f64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.674648:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0300) 00010000:00010000:1.0:1787787390.674652:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787787390.674657:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b1f64 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.674663:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b1f64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.674712:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1f5d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353ce expref: 62 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.674724:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d071b71da00) 00010000:00010000:1.0:1787787390.674726:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787787390.674730:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1f5d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353ce expref: 62 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.674752:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1de00, rc 0) 00000100:00100000:1.0:1787787390.674834:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0602efb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+61:11624:x1874630678768256:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 637us (2139us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1787787390.674842:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 217 00000100:00100000:2.0:1787787390.683246:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787390.683945:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678768384 00000100:00100000:1.0:1787787390.683960:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678768384 00000100:00100000:1.0:1787787390.684139:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 218 00000100:00100000:1.0:1787787390.684152:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0602efa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+61:11624:x1874630678768384:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787787390.684200:0:5820:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787787390.684340:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0602efa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+61:11624:x1874630678768384:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 191us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787390.684349:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 218 00000100:00100000:0.0:1787787390.688404:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787390.688629:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678768640 00000100:00100000:3.0:1787787390.688642:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678768640 00000100:00100000:2.0:1787787390.688842:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 219 00000100:00100000:2.0:1787787390.688856:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0601f96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+61:11624:x1874630678768640:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787787390.688896:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787390.688918:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787787390.688957:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1da00/0xdeb1953cba4b1f02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353b2 expref: 61 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.688981:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:2.0:1787787390.688986:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787787390.689004:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1f72 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c353d5 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787787390.690771:0:5819:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1787787390.691079:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b1f79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.691100:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b1f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.691116:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b1f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.691195:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1f72 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353d5 expref: 63 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.691219:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b1f79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353d5 expref: 62 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.691228:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d07078d0400) 00010000:00010000:2.0:1787787390.691231:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787787390.691235:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd38000, rc 0) 00000100:00100000:2.0:1787787390.693045:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0601f96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+62:11624:x1874630678768640:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 4176us (4639us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1787787390.693087:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 219 00000100:00100000:2.0:1787787390.697346:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787390.697639:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678768896 00000100:00100000:3.0:1787787390.697651:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678768896 00000100:00100000:3.0:1787787390.697727:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 220 00000100:00100000:3.0:1787787390.697739:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0602efa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+62:11624:x1874630678768896:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787787390.697994:0:9687:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787390.698040:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38000/0xdeb1953cba4b1f79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353d5 expref: 62 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.698063:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d07078d0400) 00010000:00010000:3.0:1787787390.698075:0:9687:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787787390.698103:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1f87 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.698121:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1f87 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.698133:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1f87 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.700749:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1f8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xfca2f62a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.700771:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1f8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfca2f62a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.700783:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1f8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfca2f62a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.700864:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1f87 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.700871:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1f87 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.700877:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1f87 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.700883:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0700031a00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787390.700887:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1f87 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.700894:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1f87 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.700905:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:2.0:1787787390.700908:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787390.700912:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1f87 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.700933:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700031a00/0xdeb1953cba4b1f87 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.700946:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1f8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfca2f62a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.700952:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1f8e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfca2f62a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.700958:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1f8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfca2f62a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.700962:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd38600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787390.700965:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1f8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfca2f62a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.700970:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1f8e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfca2f62a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.700978:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xfca2f62a (ffff9d07078d0500) 00010000:00010000:2.0:1787787390.700980:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787390.700983:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1f8e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfca2f62a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.700989:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1f8e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfca2f62a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787390.701097:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0602efa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+61:11624:x1874630678768896:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 3356us (3760us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787787390.701106:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 220 00000100:00100000:2.0:1787787390.703531:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787390.703707:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678769024 00000100:00100000:1.0:1787787390.703720:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678769024 00000100:00100000:1.0:1787787390.703798:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 221 00000100:00100000:1.0:1787787390.703811:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0602ef8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+61:11624:x1874630678769024:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787787390.703836:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787390.703865:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1f95 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c353dc expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.703906:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b1f9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.703923:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b1f9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.703957:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b1f9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.704078:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1f95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353dc expref: 63 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.704099:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b1f9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353dc expref: 62 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.704108:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d07114ac200) 00010000:00010000:1.0:1787787390.704111:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787787390.704115:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1d800, rc 0) 00000100:00100000:1.0:1787787390.704233:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0602ef8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+62:11624:x1874630678769024:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 425us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787390.704242:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 221 00000100:00100000:0.0:1787787390.710272:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787390.714096:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678769280 00000100:00100000:1.0:1787787390.714118:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678769280 00000100:00100000:1.0:1787787390.714283:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 222 00000100:00100000:1.0:1787787390.714296:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0601f96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+62:11624:x1874630678769280:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787787390.714427:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1fa3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.714479:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1fa3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.714494:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1fa3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787787390.715083:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:1.0:1787787390.715200:0:5820:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a0364c83 reply state 0000000031b550b1 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1fa3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787390.715210:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787787390.715374:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0601f96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+64:11624:x1874630678769280:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 1069us (5103us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1787787390.715384:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 222 00010000:00010000:2.0:1787787390.717737:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1fa3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.717760:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1fa3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.717769:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1fa3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.717776:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1de00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787390.717781:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1fa3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.717789:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1fa3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.717810:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d07114ac200) 00010000:00010000:2.0:1787787390.717814:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787787390.717819:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1fa3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.717827:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1de00/0xdeb1953cba4b1fa3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787390.720315:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787390.721520:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678769408 00000100:00100000:1.0:1787787390.721532:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678769408 00000100:00100000:2.0:1787787390.722041:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 223 00000100:00100000:2.0:1787787390.722068:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0601f97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+63:11624:x1874630678769408:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787787390.722103:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787390.722131:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1faa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c353e3 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.722243:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1faa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353e3 expref: 64 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.722268:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1faa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353e3 expref: 64 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.722292:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d07114ac200) 00010000:00010000:2.0:1787787390.722295:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787787390.722299:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd38600, rc 0) 00000100:00100000:2.0:1787787390.722396:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0601f97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+64:11624:x1874630678769408:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 340us (2089us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787390.723136:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 223 00000100:00100000:0.0:1787787390.729822:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787390.729931:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678769536 00000100:00100000:1.0:1787787390.729948:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678769536 00000100:00100000:1.0:1787787390.730002:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 63 00000100:00100000:1.0:1787787390.730011:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0601f95e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+9:2345:x1874630678769536:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787787390.730325:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0601f95e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+10:2345:x1874630678769536:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 Request processed in 314us (510us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1787787390.730333:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 63 00000100:00100000:3.0:1787787390.734876:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787390.737457:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678769792 00000100:00100000:2.0:1787787390.737473:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678769792 00000100:00100000:2.0:1787787390.737573:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 60 00000100:00100000:2.0:1787787390.737586:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06023cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+64:11624:x1874630678769792:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787787390.738479:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06023cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+65:11624:x1874630678769792:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 885us (3606us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1787787390.738492:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 60 00000100:00100000:0.0:1787787390.741703:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787390.741816:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678770048 00000100:00100000:2.0:1787787390.741827:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678770048 00000100:00100000:2.0:1787787390.742077:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 224 00000100:00100000:2.0:1787787390.742088:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+65:11624:x1874630678770048:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787787390.742263:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+65:11624:x1874630678770048:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 177us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787390.742271:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 224 00000100:00100000:2.0:1787787390.747499:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787390.747640:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678770176 00000100:00100000:0.0:1787787390.747653:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678770176 00000100:00100000:0.0:1787787390.747725:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 225 00000100:00100000:0.0:1787787390.747737:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0602ef8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+65:11624:x1874630678770176:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787787390.747772:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787390.747797:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1fb1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c353ea expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.747906:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd000/0xdeb1953cba4b1fb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.747923:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd000/0xdeb1953cba4b1fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.747936:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd000/0xdeb1953cba4b1fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787390.747981:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787787390.748240:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd000/0xdeb1953cba4b1fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.748273:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc200/0xdeb1953cba4b1fb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353ea expref: 67 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.748303:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd000/0xdeb1953cba4b1fb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353ea expref: 66 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.748312:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d07114ac200) 00010000:00010000:0.0:1787787390.748315:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787787390.748319:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d07059fd000, rc 0) 00000100:00100000:0.0:1787787390.748411:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0602ef8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+66:11624:x1874630678770176:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 676us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787390.748419:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 225 00000100:00100000:2.0:1787787390.755079:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787390.755229:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678770304 00000100:00100000:3.0:1787787390.755258:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678770304 00000100:00100000:3.0:1787787390.755334:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 64 00000100:00100000:3.0:1787787390.755346:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0602ef9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+10:2344:x1874630678770304:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787787390.755379:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787390.755405:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000027a31c2/0xdeb1953cba4b1fbf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c353f1 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787787390.755477:0:6675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f787e, blocks: 0x1 00010000:00010000:3.0:1787787390.755502:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=302s v=(0 0) 00010000:00010000:3.0:1787787390.755507:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787390.755519:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000027a31c2/0xdeb1953cba4b1fbf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353f1 expref: 11 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.755539:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000027a31c2/0xdeb1953cba4b1fbf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353f1 expref: 11 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.755555:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0700031a00, rc 0) 00000100:00100000:3.0:1787787390.755631:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0602ef9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+11:2344:x1874630678770304:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 287us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787390.755639:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 64 00000100:00100000:3.0:1787787390.771815:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787390.772164:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678770560 00000100:00100000:2.0:1787787390.772178:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678770560 00000100:00100000:0.0:1787787390.773039:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 226 00000100:00100000:0.0:1787787390.773061:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06023cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+66:11624:x1874630678770560:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787787390.773208:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06023cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+66:11624:x1874630678770560:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 156us (1467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787390.773216:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 226 00000100:00100000:2.0:1787787390.780612:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787390.780746:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678770688 00000100:00100000:1.0:1787787390.780760:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678770688 00000100:00100000:1.0:1787787390.780833:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 65 00000100:00100000:1.0:1787787390.780845:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0602ef83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+11:11624:x1874630678770688:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787787390.780869:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787390.780899:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5094663/0xdeb1953cba4b1fc6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c353f8 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.780939:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000027a31c2/0xdeb1953cba4b1fbf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353f1 expref: 12 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.780969:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787787390.780974:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787390.780981:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5094663/0xdeb1953cba4b1fc6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353f8 expref: 12 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.781037:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000027a31c2/0xdeb1953cba4b1fbf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353f1 expref: 12 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.781052:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000027a31c2/0xdeb1953cba4b1fbf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353f1 expref: 12 pid: 6675 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787390.781068:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07377e6580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6673:1874630694481152:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787787390.781182:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0704e2fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787787390.785650:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07377e6580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6673:1874630694481152:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787787390.785698:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d5094663/0xdeb1953cba4b1fc6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353f8 expref: 12 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.785726:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1ce00, rc 0) 00000100:00100000:1.0:1787787390.785806:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0602ef83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+12:11624:x1874630678770688:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 4962us (5207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787390.785817:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 65 00000100:00100000:0.0:1787787390.786567:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787390.786941:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678770816 00000100:00100000:2.0:1787787390.786951:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678770816 00010000:00010000:2.0:1787787390.787004:0:8496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000027a31c2/0xdeb1953cba4b1fbf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353f1 expref: 12 pid: 6675 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787390.787056:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 83 00000100:00100000:2.0:1787787390.787067:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06032ca940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+12:2345:x1874630678770816:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787390.787085:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787390.787112:0:8496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000027a31c2/0xdeb1953cba4b1fbf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353f1 expref: 12 pid: 6675 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.787128:0:8496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000027a31c2/0xdeb1953cba4b1fbf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353f1 expref: 12 pid: 6675 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.787158:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000027a31c2/0xdeb1953cba4b1fbf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353f1 expref: 12 pid: 6675 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.787177:0:8496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787390.787182:0:8496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787390.787192:0:8496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d5094663/0xdeb1953cba4b1fc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353f8 expref: 11 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.787204:0:8496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5094663/0xdeb1953cba4b1fc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353f8 expref: 11 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.787268:0:8496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d5094663/0xdeb1953cba4b1fc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353f8 expref: 11 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787390.787286:0:8496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0602efad00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8496:1874630694481280:192.168.206.10@tcp:105: 00000100:00100000:2.0:1787787390.787406:0:8496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0708759480 going to sleep for 11 seconds 00000100:00100000:0.0:1787787390.794267:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787390.794389:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678770944 00000100:00100000:2.0:1787787390.794399:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678770944 00002000:00100000:2.0:1787787390.794475:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9d073fe00780 x1874630678770944/t0(0) o4->c5599457-aa74-4a71-951f-faabe33e6ec7@192.168.206.10@tcp:251/0 lens 504/0 e 0 to 0 dl 1787787401 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787787390.794487:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d073fe00780 with x1874630678770944 ext(0->12) 00002000:00010000:2.0:1787787390.794494:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d073fe00780 00000100:00100000:2.0:1787787390.794541:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:2.0:1787787390.794551:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe00780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+12:2345:x1874630678770944:12345-192.168.206.10@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787787390.795977:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe00780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+14:2345:x1874630678770944:12345-192.168.206.10@tcp:4:lhsmtool_posix.0 Request processed in 1417us (1711us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1787787390.795991:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 7 00002000:00100000:2.0:1787787390.796002:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9d073fe00780 x1874630678770944/t4294967321(0) o4->c5599457-aa74-4a71-951f-faabe33e6ec7@192.168.206.10@tcp:251/0 lens 504/448 e 0 to 0 dl 1787787401 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787787390.796024:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d073fe00780 with x1874630678770944 ext(0->12) 00002000:00010000:2.0:1787787390.796031:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d073fe00780 00000100:00100000:3.0:1787787390.798381:0:8496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0602efad00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8496:1874630694481280:192.168.206.10@tcp:105: 00010000:00010000:3.0:1787787390.798422:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787390.802653:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06032ca940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+13:2345:x1874630678770816:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 15572us (16073us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787390.802672:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 83 00000100:00100000:0.0:1787787390.802865:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787390.805664:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678771072 00000100:00100000:1.0:1787787390.805683:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678771072 00000100:00100000:1.0:1787787390.805888:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 227 00000100:00100000:1.0:1787787390.805917:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070303f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+66:11624:x1874630678771072:12345-192.168.206.10@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1787787390.844735:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787787390.844772:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d070303de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694481408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787390.844858:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787390.845133:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694481408 00000100:00100000:2.0:1787787390.845145:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694481408 00000100:00100000:2.0:1787787390.845207:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787787390.845234:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070303fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1874630694481408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787787390.845265:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787390.845331:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070303fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1874630694481408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787390.845340:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787787390.845761:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d070303de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694481408:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1787787390.849083:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967497 is committed 00000001:00080000:3.0:1787787390.849116:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000001:00080000:3.0:1787787390.849166:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:3.0:1787787390.849185:0:5842:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d073fd9a000 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1787787390.849191:0:5842:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d072d9cc900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d073fd9a780 00000020:00080000:3.0:1787787390.849194:0:5842:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d072d9ccd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d0602b55c00 00000020:00080000:3.0:1787787390.849221:0:5842:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d0734690c00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1787787390.849225:0:5842:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d06032ac300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d0734690600 00000020:00080000:3.0:1787787390.849228:0:5842:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d06032aca00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d073fe87000 00000004:00080000:3.0:1787787390.849242:0:5842:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:3.0:1787787390.849273:0:5842:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000100:00100000:3.0:1787787390.849527:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06023ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694481664:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787787390.849628:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787390.849686:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787787390.849693:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06023ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694481536:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787787390.849719:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787390.849767:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694481664 00000100:00100000:3.0:1787787390.849775:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694481664 00000100:00100000:3.0:1787787390.849824:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694481536 00000100:00100000:3.0:1787787390.849828:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694481536 00000100:00100000:3.0:1787787390.849853:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787787390.849862:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073407e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3292:x1874630694481664:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787787390.849894:0:6675:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1787787390.849924:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1fcd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.849974:0:6675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000678d735f/0xdeb1953cba4b1d8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35357 expref: 12 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.849983:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1787787390.849987:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787787390.849992:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1fcd lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.850023:0:6675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000678d735f/0xdeb1953cba4b1d8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35357 expref: 12 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.850039:0:6675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000678d735f/0xdeb1953cba4b1d8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35357 expref: 12 pid: 6675 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787390.850052:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06023ccb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6675:1874630694481792:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787787390.850118:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073fd9a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787390.850137:0:10776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787787390.850146:0:10776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06023cc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3292:x1874630694481536:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787787390.850159:0:10776:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1787787390.850189:0:10776:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8f787d, atime: 0x6a8f787d, ctime: 0x6a8f787d, blocks: 0x1 00010000:00010000:3.0:1787787390.850196:0:10776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000027a31c2/0xdeb1953cba4b1fd4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.850206:0:10776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=303s v=(0 0) 00010000:00010000:3.0:1787787390.850216:0:10776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787390.850223:0:10776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000027a31c2/0xdeb1953cba4b1fd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.850240:0:10776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000027a31c2/0xdeb1953cba4b1fd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.850250:0:10776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000027a31c2/0xdeb1953cba4b1fd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.850258:0:10776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000027a31c2/0xdeb1953cba4b1fd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.850281:0:10776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787787390.850946:0:10776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06023cc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3292:x1874630694481536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 797us (1222us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787787390.850956:0:10776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:3.0:1787787390.851113:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787390.851121:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000027a31c2/0xdeb1953cba4b1fd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.851133:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0700031a00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787390.851137:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000027a31c2/0xdeb1953cba4b1fd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.851148:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000027a31c2/0xdeb1953cba4b1fd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.851182:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000027a31c2/0xdeb1953cba4b1fd4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.851190:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000027a31c2/0xdeb1953cba4b1fd4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.851212:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787390.851213:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787390.851215:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787787390.851253:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d06023ce580/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787787390.851259:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06023ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694481536:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787787390.851888:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070303f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+20:11624:x1874630678771072:12345-192.168.206.10@tcp:44:lhsmtool_posix.0 Request processed in 45969us (49019us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787390.851898:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 227 00000020:00080000:0.0:1787787390.853323:0:5853:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1787787390.854020:0:5853:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1787787390.855713:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06023ccb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6675:1874630694481792:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787787390.855762:0:6675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1fcd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787390.855964:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787390.856551:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678771200 00000100:00100000:0.0:1787787390.856561:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678771200 00010000:00010000:0.0:1787787390.856620:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000678d735f/0xdeb1953cba4b1d8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35357 expref: 13 pid: 6675 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787390.856668:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 84 00000100:00100000:0.0:1787787390.856679:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0602efa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+13:2345:x1874630678771200:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787390.856696:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787390.856702:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000678d735f/0xdeb1953cba4b1d8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35357 expref: 13 pid: 6675 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.856718:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000678d735f/0xdeb1953cba4b1d8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35357 expref: 13 pid: 6675 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.856744:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000678d735f/0xdeb1953cba4b1d8f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35357 expref: 13 pid: 6675 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.856776:0:5805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787787390.856781:0:5805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787787390.856787:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1fcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.856822:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1fcd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.856861:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787390.856932:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0602efa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+12:2345:x1874630678771200:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 254us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787390.856941:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 84 00010000:00010000:2.0:1787787390.857238:0:6675:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1fcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.857250:0:6675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1fcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.857261:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1fcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.857269:0:6675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1fcd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.857295:0:6675:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787787390.858059:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073407e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3292:x1874630694481664:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8192us (8426us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1787787390.858071:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:1.0:1787787390.858766:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d06023ce940/2, rc 0, transno 4294967322 00000100:00100000:1.0:1787787390.858792:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06023ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694481664:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1787787390.859706:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787390.859721:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1fcd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.859736:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0700031c00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:0.0:1787787390.859741:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1fcd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.859881:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1fcd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.859906:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1fcd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.859915:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca3eb6c6/0xdeb1953cba4b1fcd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.859942:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787390.859963:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787390.859965:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787390.860584:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787390.860652:0:10776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678771328 00000100:00100000:0.0:1787787390.860663:0:10776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678771328 00000100:00100000:0.0:1787787390.860727:0:10776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 68 00000100:00100000:0.0:1787787390.860737:0:10776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06023cd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+12:2345:x1874630678771328:12345-192.168.206.10@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787787390.895845:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000001:00080000:2.0:1787787390.895889:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:2.0:1787787390.895896:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:2.0:1787787390.895901:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:0.0:1787787390.896078:0:10776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06023cd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2345:x1874630678771328:12345-192.168.206.10@tcp:16:lhsmtool_posix.0 Request processed in 35334us (35502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787390.896092:0:10776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 68 00000100:00100000:2.0:1787787390.898623:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787390.898704:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678771584 00000100:00100000:1.0:1787787390.898716:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678771584 00000100:00100000:1.0:1787787390.898780:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 228 00000100:00100000:1.0:1787787390.898790:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0602ef9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+20:11624:x1874630678771584:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787787390.898867:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787390.898903:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd000/0xdeb1953cba4b1fb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353ea expref: 20 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.898926:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d07114ac200) 00010000:00010000:1.0:1787787390.898932:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787787390.898968:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1fdb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.898983:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1fdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.898994:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1fdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787787390.899430:0:5820:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe55e2bd reply state 00000000eabff43e transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1fdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787390.899514:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787787390.899642:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0602ef9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+21:11624:x1874630678771584:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 852us (1032us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1787787390.899671:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 228 00000100:00100000:2.0:1787787390.902121:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00010000:00010000:0.0:1787787390.902203:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1fdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.902218:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1fdb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.902227:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1fdb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.902233:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1c600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787390.902239:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1fdb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.902248:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1fdb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.902269:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d07114ac200) 00010000:00010000:0.0:1787787390.902273:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787390.902278:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1fdb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.902285:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c600/0xdeb1953cba4b1fdb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787390.902350:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678771712 00000100:00100000:3.0:1787787390.902374:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678771712 00000100:00100000:3.0:1787787390.902605:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 69 00000100:00100000:3.0:1787787390.902620:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0602ef83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2345:x1874630678771712:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787787390.903016:0:6673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787787390.903021:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787787390 00002000:00010000:3.0:1787787390.903023:0:6673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787787389 00002000:00010000:3.0:1787787390.903025:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787787390 -> 1787787390 00002000:00010000:3.0:1787787390.903028:0:6673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787787390.903108:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0602ef83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+8:2345:x1874630678771712:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 Request processed in 490us (999us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1787787390.903118:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 69 00000100:00100000:2.0:1787787390.905895:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787390.905947:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678771968 00000100:00100000:0.0:1787787390.905959:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678771968 00000100:00100000:0.0:1787787390.906047:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 229 00000100:00100000:0.0:1787787390.906059:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0602ef92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+20:11624:x1874630678771968:12345-192.168.206.10@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787787390.906147:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1fe2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.906168:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b1f9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353dc expref: 20 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.906179:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1fe2 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.906222:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b1f9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353dc expref: 20 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.906237:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b1f9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353dc expref: 20 pid: 5821 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787390.906254:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d070303cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5819:1874630694481920:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787787390.906460:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0707822480 going to sleep for 11 seconds 00000100:00100000:2.0:1787787390.910037:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787390.910160:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d070303cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5819:1874630694481920:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787787390.910193:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1fe2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787390.910380:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678772096 00000100:00100000:3.0:1787787390.910406:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678772096 00010000:00010000:3.0:1787787390.910586:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b1f9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353dc expref: 21 pid: 5821 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787390.910931:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 85 00000100:00100000:2.0:1787787390.910948:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0602efb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+21:2344:x1874630678772096:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787390.910968:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787390.910977:0:8496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b1f9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353dc expref: 21 pid: 5821 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.910991:0:8496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b1f9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353dc expref: 21 pid: 5821 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.911019:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b1f9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353dc expref: 21 pid: 5821 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.911039:0:8496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d07114ac200) 00010000:00010000:2.0:1787787390.911045:0:8496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1fe2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.911056:0:8496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1fe2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.911066:0:8496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1fe2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.911163:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787390.911238:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0602efb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+20:2344:x1874630678772096:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 296us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787390.911246:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 85 00010000:00010000:0.0:1787787390.912645:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1fe2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.912983:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1fe2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.913026:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1fe2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.913033:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1fe2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.913040:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1fe2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.913047:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fc000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787390.913052:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1fe2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.913060:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1fe2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.913078:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d07114ac200) 00010000:00010000:0.0:1787787390.913081:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787787390.913086:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1fe2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.913092:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1fe2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787390.913262:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0602ef92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+19:11624:x1874630678771968:12345-192.168.206.10@tcp:55:lhsmtool_posix.0 Request processed in 7199us (7371us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787787390.913274:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 229 00000100:00100000:2.0:1787787390.918616:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787390.918895:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678772224 00000100:00100000:1.0:1787787390.918908:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678772224 00000100:00100000:1.0:1787787390.918977:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 70 00000100:00100000:1.0:1787787390.918989:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0602ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+8:2344:x1874630678772224:12345-192.168.206.10@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787787390.919056:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000010c8cb7f/0xdeb1953cba4b1fe9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.919081:0:6674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d5094663/0xdeb1953cba4b1fc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353f8 expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.919091:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787390.919096:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787787390.919101:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010c8cb7f/0xdeb1953cba4b1fe9 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.919140:0:6674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d5094663/0xdeb1953cba4b1fc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353f8 expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.919155:0:6674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d5094663/0xdeb1953cba4b1fc6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353f8 expref: 8 pid: 6673 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787390.919173:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07377e6580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6674:1874630694482048:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787787390.919318:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0704e2f600 going to sleep for 11 seconds 00000100:00100000:3.0:1787787390.923484:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787390.923586:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678772352 00000100:00100000:0.0:1787787390.923598:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678772352 00010000:00010000:0.0:1787787390.923645:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d5094663/0xdeb1953cba4b1fc6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353f8 expref: 9 pid: 6673 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787390.923697:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 86 00000100:00100000:0.0:1787787390.923707:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06023cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+9:2345:x1874630678772352:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787390.923729:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787390.923767:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d5094663/0xdeb1953cba4b1fc6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353f8 expref: 9 pid: 6673 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.923782:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d5094663/0xdeb1953cba4b1fc6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353f8 expref: 9 pid: 6673 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.923825:0:5805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787787390.923830:0:5805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787787390.923837:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010c8cb7f/0xdeb1953cba4b1fe9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.923848:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010c8cb7f/0xdeb1953cba4b1fe9 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.923874:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787390.923937:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06023cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+9:2345:x1874630678772352:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 230us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787390.923945:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 86 00010000:00010000:1.0:1787787390.925614:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5094663/0xdeb1953cba4b1fc6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353f8 expref: 8 pid: 6673 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787390.925738:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07377e6580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6674:1874630694482048:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787787390.925910:0:6674:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010c8cb7f/0xdeb1953cba4b1fe9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.925925:0:6674:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010c8cb7f/0xdeb1953cba4b1fe9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.925932:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010c8cb7f/0xdeb1953cba4b1fe9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.925973:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000010c8cb7f/0xdeb1953cba4b1fe9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.925983:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010c8cb7f/0xdeb1953cba4b1fe9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.925992:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010c8cb7f/0xdeb1953cba4b1fe9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.926000:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1c800 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:1.0:1787787390.926061:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010c8cb7f/0xdeb1953cba4b1fe9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.926073:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010c8cb7f/0xdeb1953cba4b1fe9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.926102:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010c8cb7f/0xdeb1953cba4b1fe9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.926111:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010c8cb7f/0xdeb1953cba4b1fe9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787390.926283:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0602ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2344:x1874630678772224:12345-192.168.206.10@tcp:1:lhsmtool_posix.0 Request processed in 7294us (7679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787390.926294:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 70 00000100:00100000:2.0:1787787390.929331:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787390.929553:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678772608 00000100:00100000:0.0:1787787390.929581:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678772608 00000100:00100000:0.0:1787787390.929742:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 230 00000100:00100000:0.0:1787787390.929863:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0602ef9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+19:11624:x1874630678772608:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787787390.929961:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1ff0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.929982:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1ff0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.929995:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1ff0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.930314:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1ff7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.930328:0:9687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1faa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353e3 expref: 20 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.930338:0:9687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1ff7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.930391:0:9687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1faa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353e3 expref: 20 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.930408:0:9687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1faa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353e3 expref: 20 pid: 5819 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787390.930425:0:9687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d070303cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9687:1874630694482176:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787787390.930609:0:9687:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0707822480 going to sleep for 11 seconds 00000100:00100000:0.0:1787787390.933603:0:9687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d070303cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9687:1874630694482176:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787787390.933660:0:9687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1ff7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787390.934552:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787390.938631:0:8496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678772736 00000100:00100000:3.0:1787787390.938651:0:8496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678772736 00010000:00010000:3.0:1787787390.939067:0:8496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1faa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353e3 expref: 21 pid: 5819 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787390.939206:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 87 00000100:00100000:3.0:1787787390.939219:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705817050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+21:2345:x1874630678772736:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787390.939238:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787390.939247:0:8496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1faa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353e3 expref: 21 pid: 5819 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.939263:0:8496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1faa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353e3 expref: 21 pid: 5819 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.939291:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b1faa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353e3 expref: 21 pid: 5819 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.939312:0:8496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d07114ac200) 00010000:00010000:3.0:1787787390.939317:0:8496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1ff7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.939327:0:8496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1ff7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.939359:0:8496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1ff7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787390.939402:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787390.939534:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705817050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+20:2345:x1874630678772736:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 316us (4987us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787390.939542:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 87 00010000:00010000:0.0:1787787390.940379:0:9687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1ff7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.940393:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1ff7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787787390.940862:0:9687:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1787787390.941186:0:9687:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1787787390.941237:0:9687:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1787787390.941340:0:9687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d070303cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9687:1874630694482304:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787787390.941435:0:9687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787390.943205:0:9687:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07078229c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787390.943532:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694482304 00000100:00100000:2.0:1787787390.943545:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694482304 00000100:00100000:2.0:1787787390.943620:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787787390.943632:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070303c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9687:x1874630694482304:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787787390.943928:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070303c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9687:x1874630694482304:12345-0@lo:1000:mdt00_003.0 Request processed in 299us (2492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787390.943937:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787787390.944015:0:9687:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:0.0:1787787390.944090:0:9687:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:0.0:1787787390.944114:0:9687:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d06023ce940, transno 4294967322 00000100:00100000:0.0:1787787390.944236:0:9687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d070303cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9687:1874630694482304:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1787787390.944893:0:9687:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1787787390.944996:0:9687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d070303cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9687:1874630694482432:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787787390.945699:0:9687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787390.945859:0:9687:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071046c480 going to sleep for 11 seconds 00000100:00100000:3.0:1787787390.945917:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694482432 00000100:00100000:3.0:1787787390.945925:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694482432 00000100:00100000:3.0:1787787390.946017:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787787390.946091:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070303e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9687:x1874630694482432:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787787390.946433:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070303e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9687:x1874630694482432:12345-0@lo:1000:mdt00_003.0 Request processed in 406us (737us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1787787390.946477:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787787390.946689:0:9687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d070303cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9687:1874630694482432:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787787390.946736:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1ff7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.946748:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1ff7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.946757:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1ff7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.946776:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fd200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787390.946781:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1ff7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.946790:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1ff7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.946808:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d07114ac200) 00010000:00010000:1.0:1787787390.946819:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787787390.946825:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1ff7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.946832:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b1ff7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.946869:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1f3a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.946875:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1f3a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.946881:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1f3a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.946885:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fc400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787390.946888:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1f3a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.946893:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1f3a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.946902:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0300) 00010000:00010000:1.0:1787787390.946904:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787787390.946913:0:9687:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1f41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353c7 expref: 23 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.946924:0:9687:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1f41 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353c7 expref: 23 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.946934:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1f41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353c7 expref: 23 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.946978:0:9687:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1f41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353c7 expref: 23 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787390.946993:0:9687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07377e6580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9687:1874630694482560:192.168.206.10@tcp:105: 00000100:00100000:1.0:1787787390.947201:0:9687:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0704e2f600 going to sleep for 11 seconds 00000100:00100000:2.0:1787787390.949958:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787390.949995:0:9687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07377e6580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9687:1874630694482560:192.168.206.10@tcp:105: 00010000:00010000:1.0:1787787390.950031:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1f3a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.950044:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b1f3a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.950092:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1ffe lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.950109:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1ffe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.950122:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1ffe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.950134:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1ffe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.950141:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1ffe lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.950149:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1ffe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.950177:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1c800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787390.950181:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1ffe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.950189:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1ffe lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.950203:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0300) 00010000:00010000:1.0:1787787390.950206:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787390.950211:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1ffe lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.950216:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b1ffe lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.950227:0:9687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1ff0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.950233:0:9687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1ff0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.950238:0:9687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1ff0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.950242:0:9687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fc000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787390.950245:0:9687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1ff0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.950251:0:9687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1ff0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.950269:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0300) 00010000:00010000:1.0:1787787390.950271:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787787390.950274:0:9687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1ff0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.950280:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc000/0xdeb1953cba4b1ff0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787390.950541:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678772864 00000100:00100000:0.0:1787787390.950550:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678772864 00000100:00100000:0.0:1787787390.950622:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 61 00000100:00100000:0.0:1787787390.950632:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0602ef8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+24:11623:x1874630678772864:12345-192.168.206.10@tcp:49:lfs.0 00000100:00100000:0.0:1787787390.950923:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0602ef8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+24:11623:x1874630678772864:12345-192.168.206.10@tcp:49:lfs.0 Request processed in 290us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787390.950940:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 61 00000100:00100000:1.0:1787787390.951286:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0602ef9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+23:11624:x1874630678772608:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 21429us (21965us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1787787390.951295:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 230 00000020:00080000:1.0:1787787390.951299:0:9687:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787787390.952547:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787787390.952826:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1787787390.953382:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000040:00080000:2.0:1787787390.953503:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000100:00100000:1.0:1787787390.953504:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678773120 00000100:00100000:1.0:1787787390.953515:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678773120 00000040:00080000:2.0:1787787390.953516:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787787390.953577:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 231 00000100:00100000:1.0:1787787390.953588:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06023ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+23:11623:x1874630678773120:12345-192.168.206.10@tcp:58:lfs.0 00000040:00080000:1.0:1787787390.954037:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1787787390.954125:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06023ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+23:11623:x1874630678773120:12345-192.168.206.10@tcp:58:lfs.0 Request processed in 538us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787390.954135:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 231 00000100:00100000:3.0:1787787390.957768:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787390.957889:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678773376 00000100:00100000:0.0:1787787390.957903:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678773376 00000100:00100000:0.0:1787787390.957981:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 62 00000100:00100000:0.0:1787787390.957992:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703167850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+23:11624:x1874630678773376:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787787390.958874:0:5822:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787787390.958990:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1787787390.959044:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fca00/0xdeb1953cba4b2005 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.959063:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fca00/0xdeb1953cba4b2005 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.959076:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fca00/0xdeb1953cba4b2005 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.959085:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fca00/0xdeb1953cba4b2005 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.959093:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fca00/0xdeb1953cba4b2005 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.959099:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fca00/0xdeb1953cba4b2005 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787390.959129:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787787390.959297:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703167850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+25:11624:x1874630678773376:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 1304us (1540us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1787787390.959307:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 62 00000020:00080000:0.0:1787787390.959320:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787787390.959670:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787390.959679:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fca00/0xdeb1953cba4b2005 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.959689:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fca00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:2.0:1787787390.959694:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fca00/0xdeb1953cba4b2005 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.959703:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fca00/0xdeb1953cba4b2005 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.959725:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d07096a0100) 00010000:00010000:2.0:1787787390.959729:0:8439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787787390.959734:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fca00/0xdeb1953cba4b2005 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.959740:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fca00/0xdeb1953cba4b2005 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787390.959767:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787390.959769:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787390.959771:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787390.990790:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787390.991191:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678773504 00000100:00100000:1.0:1787787390.991204:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678773504 00000100:00100000:1.0:1787787390.991321:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 232 00000100:00100000:1.0:1787787390.991334:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0602efb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+25:11626:x1874630678773504:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787787390.991373:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787390.991400:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b200c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c353ff expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.991544:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b2013 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.991563:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b2013 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.991576:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b2013 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.991592:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1cc00/0xdeb1953cba4b201a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.991599:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1cc00/0xdeb1953cba4b201a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.991606:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1cc00/0xdeb1953cba4b201a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.991960:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b2021 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.991974:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1f2c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353c0 expref: 26 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.991982:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b2021 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.992035:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1f2c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353c0 expref: 26 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787390.992064:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1f2c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353c0 expref: 26 pid: 5820 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787390.992081:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07377e6580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1874630694482688:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787787390.992193:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0704e2fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787390.996628:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787390.996788:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678773760 00000100:00100000:3.0:1787787390.996799:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678773760 00000100:00100000:3.0:1787787390.997022:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 63 00000100:00100000:3.0:1787787390.997035:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0602ef9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+27:5581:x1874630678773760:12345-192.168.206.10@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787787390.997332:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0602ef9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+28:5581:x1874630678773760:12345-192.168.206.10@tcp:35:ldlm_bl.0 Request processed in 299us (716us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1787787390.997340:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 63 00000100:00100000:1.0:1787787390.997646:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07377e6580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1874630694482688:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787787390.997677:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b2021 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787391.000941:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787391.001296:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678773888 00000100:00100000:0.0:1787787391.001310:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678773888 00010000:00010000:0.0:1787787391.001395:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1f2c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353c0 expref: 28 pid: 5820 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787391.001481:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 88 00000100:00100000:0.0:1787787391.001492:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0602efbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+28:2344:x1874630678773888:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787391.001512:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787391.001529:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1f2c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353c0 expref: 28 pid: 5820 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787391.001544:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1f2c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353c0 expref: 28 pid: 5820 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787391.001573:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1dc00/0xdeb1953cba4b1f2c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353c0 expref: 28 pid: 5820 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787391.001594:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0300) 00010000:00010000:0.0:1787787391.001600:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b2021 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787391.001612:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b2021 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787391.001622:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b2021 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787391.001648:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787391.001714:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0602efbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+27:2344:x1874630678773888:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 223us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787391.001741:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 88 00010000:00010000:1.0:1787787391.001964:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b2021 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787391.001975:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b2021 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787391.002041:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787787391.002046:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787787391.002069:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b2021 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787391.002084:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b2021 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787391.002094:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b2013 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787391.002102:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b2013 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787391.002121:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b2013 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787391.002128:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1ce00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787391.002133:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b2013 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787391.002142:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b2013 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787391.002153:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:1.0:1787787391.002156:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787391.002160:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b2013 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787391.002167:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ce00/0xdeb1953cba4b2013 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787391.002178:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1cc00/0xdeb1953cba4b201a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787391.002184:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1cc00/0xdeb1953cba4b201a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787391.002190:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1cc00/0xdeb1953cba4b201a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787391.002195:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1cc00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787391.002198:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1cc00/0xdeb1953cba4b201a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787391.002214:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1cc00/0xdeb1953cba4b201a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787391.002222:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d07114ac200) 00010000:00010000:1.0:1787787391.002224:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787391.002228:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1cc00/0xdeb1953cba4b201a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787391.002234:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1cc00/0xdeb1953cba4b201a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787391.002274:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c800/0xdeb1953cba4b200c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353ff expref: 27 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787391.002289:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b2021 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353ff expref: 26 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787391.002297:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0300) 00010000:00010000:1.0:1787787391.002300:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787787391.002303:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1d800, rc 0) 00000100:00100000:1.0:1787787391.002335:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0602efb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+26:11626:x1874630678773504:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 11005us (11559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787391.002343:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 232 00000100:00080000:2.0:1787787391.002717:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787787391.613264:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787787391.769235:0:12602:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787787391.769246:0:12602:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787787391.770178:0:12602:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787787391.770185:0:12602:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000004:00080000:0.0:1787787391.870328:0:6715:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 304096887179ns, next at 305096885331ns, rc = 0 00000100:00100000:0.0:1787787391.870349:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787787391.870378:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d070303da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694482816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787787391.870458:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787391.870515:0:12107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694482816 00000100:00100000:0.0:1787787391.870522:0:12107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694482816 00000100:00100000:0.0:1787787391.870563:0:12107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787787391.870573:0:12107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070303de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1874630694482816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787787391.870595:0:12107:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1787787391.870633:0:12107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070303de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1874630694482816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787391.870639:0:12107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787787391.870676:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d070303da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694482816:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787787391.996759:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787787391.996767:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787787391.996822:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787787391.996831:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787787391.996944:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0602efa1c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874630694482944:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787787391.997046:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0601aad9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787391.998805:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0602efa1c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874630694482944:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787787392.007256:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787392.009995:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678774016 00000100:00100000:1.0:1787787392.010008:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678774016 00000100:00100000:1.0:1787787392.010089:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 233 00000100:00100000:1.0:1787787392.010100:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0602efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+26:11638:x1874630678774016:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787787392.010149:0:5821:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787787392.010280:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0602efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+26:11638:x1874630678774016:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 181us (3031us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787392.010288:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 233 00000100:00100000:2.0:1787787392.024307:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787392.024400:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678774272 00000100:00100000:0.0:1787787392.024409:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678774272 00000100:00100000:0.0:1787787392.024487:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 234 00000100:00100000:0.0:1787787392.024497:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0602efad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+26:11638:x1874630678774272:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787787392.024516:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787392.024536:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b2028 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35406 expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787392.024643:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b202f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787392.024658:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b202f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787392.024671:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b202f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787392.024681:0:9687:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787787392.024800:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fc400/0xdeb1953cba4b2028 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35406 expref: 29 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787392.024821:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b202f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35406 expref: 28 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787392.024830:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0300) 00010000:00010000:0.0:1787787392.024833:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787787392.024836:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d07059fd200, rc 0) 00000100:00100000:0.0:1787787392.024895:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0602efad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+28:11638:x1874630678774272:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 400us (596us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1787787392.024902:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 234 00000100:00100000:2.0:1787787392.037857:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787392.037941:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787392.038027:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678774656 00000100:00100000:0.0:1787787392.038036:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678774656 00000100:00100000:0.0:1787787392.038099:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 17 00000100:00100000:0.0:1787787392.038109:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0602ef8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+28:2344:x1874630678774656:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787392.038125:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787392.038159:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd200/0xdeb1953cba4b202f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35406 expref: 28 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787392.038177:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0300) 00010000:00010000:0.0:1787787392.038182:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787392.038238:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0602ef8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+27:2344:x1874630678774656:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 130us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787392.038246:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 17 00000100:00100000:1.0:1787787392.038717:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678774528 00000100:00100000:1.0:1787787392.038723:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678774528 00000100:00100000:1.0:1787787392.038766:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 235 00000100:00100000:1.0:1787787392.038774:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0602efa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+27:11638:x1874630678774528:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787787392.038845:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b203d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787392.038861:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b203d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787392.038871:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b203d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787392.039044:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b203d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787392.039053:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b203d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787392.039060:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b203d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787392.039066:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1c200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787392.039070:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b203d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787392.039089:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b203d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787392.039100:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0300) 00010000:00010000:1.0:1787787392.039103:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787787392.039106:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b203d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787392.039112:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c200/0xdeb1953cba4b203d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787392.039225:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0602efa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+28:11638:x1874630678774528:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 452us (1377us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1787787392.039233:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 235 00000040:00080000:3.0:1787787392.039535:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787787392.039546:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787787392.040719:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787787392.040733:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787787392.042821:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787392.042900:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678774912 00000100:00100000:0.0:1787787392.042908:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678774912 00000100:00100000:0.0:1787787392.042995:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 64 00000100:00100000:0.0:1787787392.043015:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+28:11638:x1874630678774912:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787787392.043229:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+29:11638:x1874630678774912:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 216us (415us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1787787392.043238:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 64 00010000:00010000:3.0:1787787392.637119:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787787393.507888:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1787787393.507910:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:0.0:1787787393.507921:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000040:00080000:0.0:1787787393.573853:0:12657:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787787393.573867:0:12657:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787787393.573916:0:12657:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787787393.573922:0:12657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787787393.662600:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787393.723911:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787393.724489:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678775168 00000100:00100000:0.0:1787787393.724503:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678775168 00000100:00080000:3.0:1787787393.724545:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787393.724592:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 236 00000100:00100000:0.0:1787787393.724604:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+29:11658:x1874630678775168:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787787393.724644:0:9687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787393.724676:0:9687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b2044 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3540d expref: -99 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787393.724801:0:9687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd800/0xdeb1953cba4b204b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787393.724818:0:9687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd800/0xdeb1953cba4b204b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787393.724832:0:9687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd800/0xdeb1953cba4b204b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9687 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787393.724844:0:9687:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787787393.724999:0:9687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b2044 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3540d expref: 32 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787393.725018:0:9687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd800/0xdeb1953cba4b204b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3540d expref: 31 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787393.725026:0:9687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0300) 00010000:00010000:0.0:1787787393.725029:0:9687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787787393.725033:0:9687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d07059fd800, rc 0) 00000100:00100000:0.0:1787787393.725115:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+31:11658:x1874630678775168:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 512us (1216us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1787787393.725124:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 236 00000100:00100000:3.0:1787787393.734060:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787393.734934:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678775296 00000100:00100000:0.0:1787787393.734949:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678775296 00000100:00100000:0.0:1787787393.735027:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 237 00000100:00100000:0.0:1787787393.735051:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06023ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+31:11658:x1874630678775296:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:0.0:1787787393.735134:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b2059 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787393.735155:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b2059 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787393.735169:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b2059 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787393.735203:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b2059 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787393.735212:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b2059 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787393.735219:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b2059 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787393.735238:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fd600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787393.735243:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b2059 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787393.735252:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b2059 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787393.735266:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0300) 00010000:00010000:0.0:1787787393.735270:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787787393.735275:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b2059 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787393.735282:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd600/0xdeb1953cba4b2059 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787393.735394:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06023ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+31:11658:x1874630678775296:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 346us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787393.735402:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 237 00000100:00100000:3.0:1787787393.839508:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787393.839598:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678775424 00000100:00100000:2.0:1787787393.839611:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678775424 00000100:00100000:2.0:1787787393.839730:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 71 00000100:00100000:2.0:1787787393.839742:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06023ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2343:x1874630678775424:12345-192.168.206.10@tcp:101:cat.0 00010000:00010000:2.0:1787787393.839764:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787393.839789:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030798ded/0xdeb1953cba4b2060 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35414 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787787393.839821:0:6675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a8f787e, atime: 0x6a8f787d, ctime: 0x6a8f787e, blocks: 0xb 00010000:00010000:2.0:1787787393.839845:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=306s v=(0 0) 00010000:00010000:2.0:1787787393.839850:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787393.839860:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030798ded/0xdeb1953cba4b2060 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35414 expref: 8 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787393.839884:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000030798ded/0xdeb1953cba4b2060 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35414 expref: 8 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787393.839899:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd39800, rc 0) 00000100:00100000:2.0:1787787393.839979:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06023ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+8:2343:x1874630678775424:12345-192.168.206.10@tcp:101:cat.0 Request processed in 240us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787393.839987:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 71 00000100:00080000:3.0:1787787393.840294:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787787393.845692:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787393.846126:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678775552 00000100:00100000:2.0:1787787393.846140:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678775552 00002000:00100000:2.0:1787787393.846210:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9d06023cd2c0 x1874630678775552/t0(0) o3->c5599457-aa74-4a71-951f-faabe33e6ec7@192.168.206.10@tcp:254/0 lens 488/0 e 0 to 0 dl 1787787404 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787787393.846223:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d06023cd2c0 with x1874630678775552 ext(0->4095) 00002000:00010000:2.0:1787787393.846230:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d06023cd2c0 00000100:00100000:2.0:1787787393.846276:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:2.0:1787787393.846304:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06023cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+8:2344:x1874630678775552:12345-192.168.206.10@tcp:3:cat.0 00000100:00100000:2.0:1787787393.846608:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06023cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+8:2344:x1874630678775552:12345-192.168.206.10@tcp:3:cat.0 Request processed in 304us (986us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787787393.846618:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 8 00002000:00100000:2.0:1787787393.846630:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9d06023cd2c0 x1874630678775552/t0(0) o3->c5599457-aa74-4a71-951f-faabe33e6ec7@192.168.206.10@tcp:254/0 lens 488/4536 e 0 to 0 dl 1787787404 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787787393.846640:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d06023cd2c0 with x1874630678775552 ext(0->4095) 00002000:00010000:2.0:1787787393.846644:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d06023cd2c0 00000100:00100000:0.0:1787787394.018852:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787394.018968:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787394.019023:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787394.019124:0:10776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678775808 00000100:00100000:3.0:1787787394.019136:0:10776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678775808 00000100:00100000:3.0:1787787394.019222:0:10776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 87 00000100:00100000:3.0:1787787394.019235:0:10776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06020ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2344:x1874630678775808:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787787394.019287:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678775936 00000100:00100000:2.0:1787787394.019294:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678775936 00000100:00100000:3.0:1787787394.019328:0:10776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06020ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2344:x1874630678775808:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 97us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787394.019339:0:10776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 87 00000100:00100000:2.0:1787787394.019353:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 149 00000100:00100000:2.0:1787787394.019366:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06020e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2345:x1874630678775936:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787787394.019403:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06020e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2345:x1874630678775936:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 41us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787394.019411:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 149 00000100:00080000:0.0:1787787394.020090:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787787394.020096:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787787394.020677:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678775680 00000100:00100000:1.0:1787787394.020689:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678775680 00000100:00100000:1.0:1787787394.020813:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 291 00000100:00100000:1.0:1787787394.020824:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2345:x1874630678775680:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787787394.020902:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2345:x1874630678775680:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 80us (2064us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787394.020910:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 291 00010000:00010000:2.0:1787787394.685561:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787395.452897:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fd7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1874630694483200:0@lo:400:kworker.0 00000100:00100000:2.0:1787787395.452961:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787395.453014:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073473e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694483712:0@lo:400:kworker.0 00000100:00100000:2.0:1787787395.453043:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787395.453049:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06010b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694483072:0@lo:400:kworker.0 00000100:00100000:2.0:1787787395.453098:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787787395.453103:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787395.453108:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fd7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694483328:0@lo:400:kworker.0 00000100:00100000:1.0:1787787395.453138:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073473ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1874630694483584:0@lo:400:kworker.0 00000100:00100000:2.0:1787787395.453143:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787395.453178:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787395.453187:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694483712 00000100:00100000:2.0:1787787395.453194:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694483712 00000100:00100000:3.0:1787787395.453203:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fd770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694483456:0@lo:400:kworker.0 00000100:00100000:1.0:1787787395.453243:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694483200 00000100:00100000:3.0:1787787395.453247:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787395.453249:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694483200 00000100:00100000:2.0:1787787395.453261:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694483456 00000100:00100000:2.0:1787787395.453266:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694483456 00000100:00100000:1.0:1787787395.453366:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694483328 00000100:00100000:1.0:1787787395.453370:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694483328 00000100:00100000:2.0:1787787395.453723:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787787395.453734:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a08b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694483712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787395.453788:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a08b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694483712:12345-0@lo:400:kworker.0 Request processed in 56us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787395.453794:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787787395.453811:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787787395.453893:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06023cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3293:x1874630694483456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787395.453930:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06023cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3293:x1874630694483456:12345-0@lo:400:kworker.0 Request processed in 43us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787395.453937:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787787395.454064:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fd770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694483456:0@lo:400:kworker.0 00000100:00100000:2.0:1787787395.454138:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694483072 00000100:00100000:2.0:1787787395.454143:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694483072 00000100:00100000:0.0:1787787395.454945:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694483584 00000100:00100000:0.0:1787787395.454952:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694483584 00000100:00100000:2.0:1787787395.454957:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1787787395.454967:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3294:x1874630694483072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787395.454988:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787787395.454997:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b120b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1874630694483200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787395.455042:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b120b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1874630694483200:12345-0@lo:400:kworker.0 Request processed in 47us (2081us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787395.455049:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787787395.455076:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3294:x1874630694483072:12345-0@lo:400:kworker.0 Request processed in 110us (1974us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787395.455085:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1787787395.455092:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787787395.455104:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694483328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787395.455135:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06010b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694483072:0@lo:400:kworker.0 00000100:00100000:1.0:1787787395.455156:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787787395.455168:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874630694483584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787395.455175:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fd7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694483328:0@lo:400:kworker.0 00000100:00100000:2.0:1787787395.455190:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fd7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1874630694483200:0@lo:400:kworker.0 00000100:00080000:0.0:1787787395.455196:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787395.455203:0:3291:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000100:00080000:0.0:1787787395.455203:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787787395.455207:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1787787395.455211:0:3291:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000100:00100000:3.0:1787787395.455219:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694483328:12345-0@lo:400:kworker.0 Request processed in 116us (2075us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787395.455227:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000004:00080000:2.0:1787787395.455230:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d06023ce580, transno 4294967310 00000100:00100000:1.0:1787787395.455245:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874630694483584:12345-0@lo:400:kworker.0 Request processed in 79us (2068us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787395.455253:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787787395.455283:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073473ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1874630694483584:0@lo:400:kworker.0 00000100:00100000:2.0:1787787395.455321:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073473e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694483712:0@lo:400:kworker.0 00010000:00010000:0.0:1787787395.710025:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787395.967710:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07377e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694483840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787787395.967791:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787395.967883:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694483840 00000100:00100000:1.0:1787787395.967890:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694483840 00000100:00100000:1.0:1787787395.967943:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787787395.967954:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694483840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787787395.967986:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787787395.968028:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694483840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787395.968035:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787787395.968091:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07377e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694483840:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1787787396.007861:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000004:00080000:2.0:1787787396.007877:0:5842:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:2.0:1787787396.007893:0:5842:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d07078229c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1787787396.007898:0:5842:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d073d8cd300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d0707822300 00000020:00080000:2.0:1787787396.007901:0:5842:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d073d8cda00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d073d8f2c00 00000020:00080000:2.0:1787787396.007917:0:5842:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1787787396.008103:0:5853:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1787787396.008276:0:5853:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:2.0:1787787396.008294:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d073fd7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694483968:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787787396.008970:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787396.009046:0:10776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694483968 00000100:00100000:2.0:1787787396.009053:0:10776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694483968 00000100:00100000:2.0:1787787396.009094:0:10776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787787396.009103:0:10776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3293:x1874630694483968:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787787396.009271:0:10776:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787787396.009274:0:10776:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1787787390 -> 1787787390 00002000:00010000:2.0:1787787396.009277:0:10776:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1787787389 -> 1787787389 00002000:00010000:2.0:1787787396.009280:0:10776:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787787390 -> 1787787390 00002000:00010000:2.0:1787787396.009282:0:10776:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787787396.009329:0:10776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3293:x1874630694483968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 228us (360us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1787787396.009347:0:10776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000004:00080000:3.0:1787787396.009395:0:3293:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d073fd7b480/2, rc 0, transno 4294967325 00000100:00100000:3.0:1787787396.009401:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d073fd7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694483968:0@lo:2:osp-syn-0-0.0 00000001:00080000:2.0:1787787396.014063:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1787787396.014229:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00010000:00010000:3.0:1787787396.732629:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787396.989285:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06020e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694484096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787396.989373:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787396.989459:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694484096 00000100:00100000:2.0:1787787396.989467:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694484096 00000100:00100000:2.0:1787787396.989510:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787787396.989519:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073d9e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1874630694484096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787787396.989550:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787396.989594:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073d9e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1874630694484096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787396.989601:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787787396.989813:0:3294:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1787787396.989820:0:3294:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1787787396.989840:0:3294:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9d073fd7b480 x1874630694483968/t4294967325(4294967325) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787787412 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787396.989857:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06020e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694484096:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1787787397.182723:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787787397.182732:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787787397.182775:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787787397.182783:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787787397.756549:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787397.866543:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787397.866709:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678776064 00000100:00100000:2.0:1787787397.866720:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678776064 00000100:00100000:2.0:1787787397.866791:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 238 00000100:00100000:2.0:1787787397.866801:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06020e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+18:11303:x1874630678776064:12345-192.168.206.10@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787787397.866904:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06020e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+18:11303:x1874630678776064:12345-192.168.206.10@tcp:60:lhsmtool_posix.0 Request processed in 104us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787397.866912:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 238 00000100:00080000:0.0:1787787397.867720:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787397.882633:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787397.882699:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678776320 00000100:00100000:1.0:1787787397.882709:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678776320 00000100:00100000:1.0:1787787397.882773:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 65 00000100:00100000:1.0:1787787397.882783:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06023ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+18:11303:x1874630678776320:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787787397.883248:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06023ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+19:11303:x1874630678776320:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 464us (621us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1787787397.883265:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 65 00000100:00100000:3.0:1787787398.145256:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787398.145408:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678776448 00000100:00100000:2.0:1787787398.145417:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678776448 00000100:00100000:2.0:1787787398.145514:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 239 00000100:00100000:2.0:1787787398.145524:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06023cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:12109:x1874630678776448:12345-192.168.206.10@tcp:101:lsof.0 00010000:00010000:2.0:1787787398.145556:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787398.145575:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b2067 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3541b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787787398.145618:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787787398.145631:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b206e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787398.145645:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b206e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787398.145658:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b206e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787398.145834:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787787398.145838:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787787398.145920:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b206e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787398.145960:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38600/0xdeb1953cba4b2067 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3541b expref: 7 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787398.145984:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b206e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3541b expref: 6 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787398.145991:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d071b71d300) 00010000:00010000:2.0:1787787398.145994:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787787398.145997:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd38c00, rc 0) 00000100:00100000:2.0:1787787398.146052:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06023cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:267c8212-9bde-4b8e-bca1-0730dc2554b7+6:12109:x1874630678776448:12345-192.168.206.10@tcp:101:lsof.0 Request processed in 529us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787398.146059:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 239 00010000:00010000:1.0:1787787398.780740:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787399.139107:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787399.139153:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787399.139194:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787399.139225:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787399.139251:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678776960 00000100:00100000:3.0:1787787399.139259:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787399.139261:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678776960 00000100:00100000:3.0:1787787399.139285:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678776832 00000100:00100000:3.0:1787787399.139291:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678776832 00000100:00100000:0.0:1787787399.139342:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 90 00000100:00100000:0.0:1787787399.139369:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06023cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2345:x1874630678776960:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787787399.139417:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678776704 00000100:00100000:2.0:1787787399.139423:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678776704 00000100:00100000:0.0:1787787399.139470:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06023cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2345:x1874630678776960:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 73us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787399.139478:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 91 00000100:00100000:2.0:1787787399.139486:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678777088 00000100:00100000:2.0:1787787399.139490:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678777088 00000100:00100000:2.0:1787787399.139511:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 153 00000100:00100000:2.0:1787787399.139520:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06023cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+19:2345:x1874630678776704:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787787399.139535:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678776576 00000100:00100000:1.0:1787787399.139541:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678776576 00000100:00100000:2.0:1787787399.139563:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06023cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5599457-aa74-4a71-951f-faabe33e6ec7+19:2345:x1874630678776704:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 43us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787399.139571:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 293 00000100:00100000:2.0:1787787399.139575:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 153 00000100:00100000:1.0:1787787399.139584:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2345:x1874630678776576:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787787399.139598:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 154 00000100:00100000:2.0:1787787399.139607:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06023ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267c8212-9bde-4b8e-bca1-0730dc2554b7+6:2345:x1874630678777088:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787787399.139619:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2345:x1874630678776576:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 37us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787399.139627:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 293 00000100:00100000:2.0:1787787399.139638:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06023ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267c8212-9bde-4b8e-bca1-0730dc2554b7+6:2345:x1874630678777088:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 31us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787399.139646:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 154 00000100:00080000:1.0:1787787399.139674:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787787399.139679:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787787399.139681:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787787399.142655:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 90 00000100:00100000:3.0:1787787399.144061:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06023cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2345:x1874630678776832:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787399.145407:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06023cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2345:x1874630678776832:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 4735us (4995us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787399.145420:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 91 00010000:00010000:0.0:1787787399.804647:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787400.575082:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874630694484352:0@lo:400:kworker.0 00000100:00100000:2.0:1787787400.575149:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787400.575198:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07185a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694484864:0@lo:400:kworker.0 00000100:00100000:2.0:1787787400.575224:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787400.575284:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787787400.575290:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694484224:0@lo:400:kworker.0 00000100:00100000:2.0:1787787400.575332:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787400.575354:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1874630694484736:0@lo:400:kworker.0 00000100:00100000:2.0:1787787400.575378:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787400.575404:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1874630694484480:0@lo:400:kworker.0 00000100:00100000:2.0:1787787400.575429:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787400.575488:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787787400.575494:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694484608:0@lo:400:kworker.0 00000100:00100000:2.0:1787787400.575517:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787400.575549:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694484352 00000100:00100000:2.0:1787787400.575555:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694484352 00000100:00100000:2.0:1787787400.575595:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694484736 00000100:00100000:2.0:1787787400.575599:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694484736 00000100:00100000:2.0:1787787400.575620:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694484480 00000100:00100000:2.0:1787787400.575623:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694484480 00000100:00100000:2.0:1787787400.575639:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787787400.575647:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07185a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1874630694484352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787400.575908:0:10776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694484864 00000100:00100000:0.0:1787787400.575913:0:10776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694484864 00000100:00100000:1.0:1787787400.576017:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694484608 00000100:00100000:1.0:1787787400.576021:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694484608 00000100:00100000:1.0:1787787400.576050:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787787400.576057:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0734768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694484864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787400.576100:0:10776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787787400.576109:0:10776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0734769a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3293:x1874630694484608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787400.576150:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07185a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1874630694484352:12345-0@lo:400:kworker.0 Request processed in 504us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787400.576157:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787787400.576174:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787787400.576179:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073476a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1874630694484736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787400.576563:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787787400.578734:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07347692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874630694484480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787400.578969:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0734768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694484864:12345-0@lo:400:kworker.0 Request processed in 2910us (3741us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787400.578980:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787787400.579114:0:10776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0734769a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3293:x1874630694484608:12345-0@lo:400:kworker.0 Request processed in 3006us (3595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787400.579122:0:10776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787787400.579186:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073476a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1874630694484736:12345-0@lo:400:kworker.0 Request processed in 3005us (3805us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787400.579192:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694484608:0@lo:400:kworker.0 00000100:00100000:2.0:1787787400.579194:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:2.0:1787787400.579220:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787787400.579224:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787787400.579228:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787400.579249:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1874630694484736:0@lo:400:kworker.0 00000100:00100000:2.0:1787787400.579262:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874630694484352:0@lo:400:kworker.0 00000100:00100000:2.0:1787787400.579272:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07185a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694484864:0@lo:400:kworker.0 00000100:00100000:0.0:1787787400.580146:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694484224 00000100:00100000:0.0:1787787400.580157:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694484224 00000100:00100000:0.0:1787787400.580269:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1787787400.580279:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3292:x1874630694484224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787400.580352:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3292:x1874630694484224:12345-0@lo:400:kworker.0 Request processed in 75us (5019us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787400.580358:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1787787400.580496:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07347692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874630694484480:12345-0@lo:400:kworker.0 Request processed in 3923us (5064us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787400.580504:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787787400.580676:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694484224:0@lo:400:kworker.0 00000100:00100000:1.0:1787787400.581102:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1874630694484480:0@lo:400:kworker.0 00010000:00010000:3.0:1787787400.834832:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787787400.884657:0:12859:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 19:36:39 (1787787399) 00000100:00100000:1.0:1787787401.085937:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07377e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694484992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787787401.088167:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787401.088261:0:12107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694484992 00000100:00100000:1.0:1787787401.088268:0:12107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694484992 00000100:00100000:1.0:1787787401.088331:0:12107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787787401.088341:0:12107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694484992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787787401.088376:0:12107:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787787401.088422:0:12107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694484992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787401.088429:0:12107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787787401.089913:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07377e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694484992:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1787787401.118901:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1787787401.118921:0:5842:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1787787401.118967:0:5853:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1787787401.118977:0:5853:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:3.0:1787787401.145268:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00010000:00010000:0.0:1787787401.853270:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787402.108793:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787787402.108817:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06020eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694485120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787402.108884:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787402.108908:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694485120 00000100:00100000:3.0:1787787402.108917:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694485120 00000100:00100000:3.0:1787787402.108985:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787787402.108996:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07185a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694485120:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787787402.109046:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1787787402.109096:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787787402.109158:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07185a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694485120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787402.109165:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787787402.109244:0:3293:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:1.0:1787787402.109250:0:3293:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d073fd7b480, transno 4294967325 00000100:00100000:1.0:1787787402.109382:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06020eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694485120:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787787402.886779:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787403.900806:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787404.260479:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787404.260519:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787404.260526:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678777216 00000100:00100000:2.0:1787787404.260535:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678777216 00000100:00100000:3.0:1787787404.260557:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787404.260741:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 295 00000100:00100000:3.0:1787787404.260754:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703093050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2345:x1874630678777216:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787404.260901:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703093050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+13:2345:x1874630678777216:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 150us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787404.260909:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 295 00000100:00100000:3.0:1787787404.260969:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787404.261728:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678777728 00000100:00100000:1.0:1787787404.261736:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678777728 00000100:00100000:1.0:1787787404.261998:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678777344 00000100:00100000:1.0:1787787404.262003:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678777344 00000100:00100000:1.0:1787787404.262104:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 158 00000100:00100000:1.0:1787787404.262114:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06023ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267c8212-9bde-4b8e-bca1-0730dc2554b7+6:2345:x1874630678777728:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787787404.262165:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06023ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:267c8212-9bde-4b8e-bca1-0730dc2554b7+6:2345:x1874630678777728:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 52us (1606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787404.262172:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 158 00000100:00100000:1.0:1787787404.262186:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 159 00000100:00100000:1.0:1787787404.262193:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+18:2345:x1874630678777344:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787787404.262217:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+18:2345:x1874630678777344:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 25us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787404.262224:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 159 00000100:00080000:1.0:1787787404.262459:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787787404.263761:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787404.265669:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678777472 00000100:00100000:2.0:1787787404.265684:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678777472 00000100:00100000:2.0:1787787404.265763:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678777600 00000100:00100000:2.0:1787787404.265767:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678777600 00000100:00100000:2.0:1787787404.265804:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 94 00000100:00100000:2.0:1787787404.265815:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06023cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2345:x1874630678777472:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787787404.265888:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06023cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2345:x1874630678777472:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 76us (5368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787404.265896:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 94 00000100:00100000:2.0:1787787404.265913:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 95 00000100:00100000:2.0:1787787404.265920:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2345:x1874630678777600:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787787404.265955:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2345:x1874630678777600:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 36us (2201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787404.265962:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 95 00000100:00080000:1.0:1787787404.266673:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787787404.266679:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787787404.489208:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787404.491150:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678777984 00000100:00100000:0.0:1787787404.491162:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678777984 00000100:00100000:0.0:1787787404.491241:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 66 00000100:00100000:0.0:1787787404.491251:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+18:12330:x1874630678777984:12345-192.168.206.10@tcp:35:umount.0 00000100:00100000:0.0:1787787404.491766:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+19:12330:x1874630678777984:12345-192.168.206.10@tcp:35:umount.0 Request processed in 515us (2567us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1787787404.491774:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 66 00000100:00100000:3.0:1787787404.500227:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787404.500877:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678778240 00000100:00100000:0.0:1787787404.500887:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678778240 00000100:00100000:0.0:1787787404.500948:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 67 00000100:00100000:0.0:1787787404.500958:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+19:12330:x1874630678778240:12345-192.168.206.10@tcp:35:umount.0 00000100:00100000:0.0:1787787404.501264:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+20:12330:x1874630678778240:12345-192.168.206.10@tcp:35:umount.0 Request processed in 306us (1045us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1787787404.501272:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 67 00000100:00100000:2.0:1787787404.508388:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787404.508828:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678778496 00000100:00100000:0.0:1787787404.508837:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678778496 00000100:00100000:0.0:1787787404.508897:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 68 00000100:00100000:0.0:1787787404.508907:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703164050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+20:12330:x1874630678778496:12345-192.168.206.10@tcp:35:umount.0 00000100:00100000:0.0:1787787404.510143:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703164050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+21:12330:x1874630678778496:12345-192.168.206.10@tcp:35:umount.0 Request processed in 1230us (1756us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1787787404.510156:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 68 00000100:00100000:3.0:1787787404.517301:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787404.517468:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678778752 00000100:00100000:1.0:1787787404.517477:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678778752 00000100:00100000:1.0:1787787404.517540:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 69 00000100:00100000:1.0:1787787404.517551:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fd770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+21:12330:x1874630678778752:12345-192.168.206.10@tcp:35:umount.0 00000100:00100000:1.0:1787787404.517887:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fd770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+22:12330:x1874630678778752:12345-192.168.206.10@tcp:35:umount.0 Request processed in 337us (605us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1787787404.517895:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 69 00000100:00100000:3.0:1787787404.520435:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787404.520501:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787404.520669:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678778880 00000100:00100000:1.0:1787787404.520678:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678778880 00000100:00100000:1.0:1787787404.520733:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678779136 00000100:00100000:1.0:1787787404.520737:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678779136 00000100:00100000:2.0:1787787404.520760:0:8496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 18 00000100:00100000:2.0:1787787404.520775:0:8496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070303cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af6a8f90-14b7-42f3-a06a-560ac8c8f006+14:2343:x1874630678778880:12345-192.168.206.10@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787787404.520781:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 19 00000100:00100000:1.0:1787787404.520793:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070303d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+14:2343:x1874630678779136:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787404.520812:0:8496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787404.520815:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787404.520835:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0708771000/0xdeb1953cba4b10e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34fa6 expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787404.520836:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0708771200/0xdeb1953cba4b12fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35071 expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787404.520863:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787787404.520877:0:8496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787404.520920:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070303d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+12:2343:x1874630678779136:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 129us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787404.520929:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 19 00000100:00100000:2.0:1787787404.522036:0:8496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070303cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af6a8f90-14b7-42f3-a06a-560ac8c8f006+11:2343:x1874630678778880:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 1259us (1603us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787404.522047:0:8496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 18 00000100:00100000:3.0:1787787404.523140:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787404.523204:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678779008 00000100:00100000:0.0:1787787404.523213:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678779008 00000100:00100000:0.0:1787787404.523280:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 20 00000100:00100000:0.0:1787787404.523300:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070303fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+11:2342:x1874630678779008:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787404.523314:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787404.523333:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0700031600/0xdeb1953cba4b104c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34f6e expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787404.523364:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787404.523398:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070303fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:2342:x1874630678779008:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 111us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787404.523406:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 20 00000100:00100000:3.0:1787787404.525703:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787404.530472:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678779264 00000100:00100000:2.0:1787787404.530486:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678779264 00000100:00100000:2.0:1787787404.530554:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 73 00000100:00100000:2.0:1787787404.530566:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070303de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+5:2341:x1874630678779264:12345-192.168.206.10@tcp:9:umount.0 00000020:00000080:2.0:1787787404.530594:0:6674:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b13be 00000100:00080000:2.0:1787787404.530604:0:6674:0:(import.c:65:import_set_state_nolock()) ffff9d0734166000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787787404.530650:0:6674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:3.0:1787787404.530769:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787404.530929:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070303de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5599457-aa74-4a71-951f-faabe33e6ec7+2:2341:x1874630678779264:12345-192.168.206.10@tcp:9:umount.0 Request processed in 364us (5233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787404.530937:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 73 00000100:00100000:3.0:1787787404.534532:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787404.534638:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678779648 00000100:00100000:1.0:1787787404.534648:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678779648 00000100:00100000:1.0:1787787404.534694:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 74 00000100:00100000:1.0:1787787404.534717:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070303da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2341:x1874630678779648:12345-192.168.206.10@tcp:9:umount.0 00000020:00000080:1.0:1787787404.534752:0:6673:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b1626 00000020:00010000:1.0:1787787404.534762:0:6673:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9d07055ec800: total 0 00000100:00080000:1.0:1787787404.534767:0:6673:0:(import.c:65:import_set_state_nolock()) ffff9d07055e9800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787787404.534815:0:6673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000020:00010000:0.0:1787787404.535148:0:8440:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9d07055ec800: total 0 00010000:00010000:0.0:1787787404.535182:0:8440:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9d07055ec800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1787787404.535235:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048260c51/0xdeb1953cba4b19c2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35246 expref: 5 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787404.535267:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030798ded/0xdeb1953cba4b2060 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35414 expref: 4 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787404.535281:0:8440:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9d07055ec800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1787787404.535304:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787404.535306:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787404.535307:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787404.535778:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070303da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+2:2341:x1874630678779648:12345-192.168.206.10@tcp:9:umount.0 Request processed in 1061us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787404.535787:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 74 00000100:00100000:3.0:1787787404.545693:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787404.547761:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678780672 00000100:00100000:1.0:1787787404.547777:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678780672 00000100:00100000:1.0:1787787404.547855:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 240 00000100:00100000:1.0:1787787404.547864:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06025cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+22:2341:x1874630678780672:12345-192.168.206.10@tcp:39:umount.0 00000020:00000080:1.0:1787787404.547894:0:5819:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b105a 00000020:00010000:1.0:1787787404.547911:0:5819:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9d073ff90000: total 0 00000100:00080000:1.0:1787787404.547916:0:5819:0:(import.c:65:import_set_state_nolock()) ffff9d073ff97000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787787404.547947:0:5819:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:3.0:1787787404.548514:0:8439:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9d073ff90000: total 0 00010000:00010000:3.0:1787787404.548555:0:8439:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9d073ff90000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1787787404.548624:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d071b71da00) 00010000:00010000:3.0:1787787404.548628:0:8439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787404.548637:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771400/0xdeb1953cba4b1340 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35086 expref: 23 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787404.548676:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07114acf00) 00010000:00010000:3.0:1787787404.548679:0:8439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787787404.548684:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1ca00/0xdeb1953cba4b1983 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35231 expref: 22 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787404.548699:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0300) 00010000:00010000:3.0:1787787404.548701:0:8439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787787404.548705:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d800/0xdeb1953cba4b2021 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353ff expref: 21 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787404.548717:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d071b71d300) 00010000:00010000:3.0:1787787404.548720:0:8439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787787404.548723:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771800/0xdeb1953cba4b1a24 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35262 expref: 20 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787404.548735:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0300) 00010000:00010000:3.0:1787787404.548738:0:8439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787787404.548741:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d07059fd800/0xdeb1953cba4b204b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3540d expref: 19 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787404.548786:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d07078d0f00) 00010000:00010000:3.0:1787787404.548788:0:8439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787787404.548793:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771e00/0xdeb1953cba4b1681 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3516d expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787404.548815:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d07078d0800) 00010000:00010000:3.0:1787787404.548818:0:8439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787787404.548822:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39a00/0xdeb1953cba4b1324 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3507f expref: 17 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787404.548837:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07114acf00) 00010000:00010000:3.0:1787787404.548839:0:8439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787787404.548843:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1c000/0xdeb1953cba4b19ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3523f expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787404.548854:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:3.0:1787787404.548856:0:8439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787787404.548860:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d600/0xdeb1953cba4b1d1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3533b expref: 15 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787404.548870:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d07078d0f00) 00010000:00010000:3.0:1787787404.548872:0:8439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787787404.548875:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39600/0xdeb1953cba4b1394 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3509b expref: 14 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787404.548887:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d07078d0300) 00010000:00010000:3.0:1787787404.548889:0:8439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787787404.548899:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030800/0xdeb1953cba4b1f41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c353c7 expref: 13 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787404.548914:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d071b71db00) 00010000:00010000:3.0:1787787404.548916:0:8439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787787404.548920:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0700030200/0xdeb1953cba4b1a40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35269 expref: 12 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787404.548933:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d07114acf00) 00010000:00010000:3.0:1787787404.548935:0:8439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787787404.548939:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0737a1d400/0xdeb1953cba4b18a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c351f9 expref: 11 pid: 9687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787404.548950:0:8439:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9d073ff90000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1787787404.548962:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787404.548964:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787404.548966:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787404.549383:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06025cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5599457-aa74-4a71-951f-faabe33e6ec7+7:2341:x1874630678780672:12345-192.168.206.10@tcp:39:umount.0 Request processed in 1518us (3697us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1787787404.549394:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 240 00010000:00010000:0.0:1787787404.924704:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787405.692690:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694485632:0@lo:400:kworker.0 00000100:00100000:2.0:1787787405.692757:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787405.692832:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787787405.692839:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1874630694485504:0@lo:400:kworker.0 00000100:00100000:2.0:1787787405.692865:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787405.692899:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694485632 00000100:00100000:2.0:1787787405.692907:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694485632 00000100:00100000:2.0:1787787405.692976:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787787405.692986:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694485632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787405.693033:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694485632:12345-0@lo:400:kworker.0 Request processed in 49us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787405.693055:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:2.0:1787787405.693076:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787405.693103:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694485632:0@lo:400:kworker.0 00000100:00100000:3.0:1787787405.693418:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b120f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874630694485376:0@lo:400:kworker.0 00000100:00100000:3.0:1787787405.693473:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787405.693506:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e4bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694485888:0@lo:400:kworker.0 00000100:00100000:3.0:1787787405.693527:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787405.693551:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787787405.693556:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694485248:0@lo:400:kworker.0 00000100:00100000:3.0:1787787405.693583:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787405.693614:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1874630694485760:0@lo:400:kworker.0 00000100:00100000:3.0:1787787405.693635:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787405.693663:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694485504 00000100:00100000:3.0:1787787405.693674:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694485504 00000100:00100000:3.0:1787787405.693701:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694485376 00000100:00100000:3.0:1787787405.693703:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694485376 00000100:00100000:3.0:1787787405.693715:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694485760 00000100:00100000:3.0:1787787405.693717:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694485760 00000100:00100000:3.0:1787787405.693732:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787787405.693738:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1874630694485504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787405.693786:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1874630694485504:12345-0@lo:400:kworker.0 Request processed in 49us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787405.693793:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787787405.693806:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787787405.693812:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06025cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1874630694485376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787405.693842:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06025cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1874630694485376:12345-0@lo:400:kworker.0 Request processed in 31us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787405.693848:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787787405.693859:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787787405.693867:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06025c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1874630694485760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787405.693891:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06025c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1874630694485760:12345-0@lo:400:kworker.0 Request processed in 28us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787405.693896:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787787405.694112:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1874630694485760:0@lo:400:kworker.0 00000100:00100000:3.0:1787787405.694130:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b120f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874630694485376:0@lo:400:kworker.0 00000100:00100000:0.0:1787787405.694247:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694485248 00000100:00100000:0.0:1787787405.694252:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694485248 00000100:00100000:0.0:1787787405.694291:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1787787405.694300:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3292:x1874630694485248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787405.694342:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3292:x1874630694485248:12345-0@lo:400:kworker.0 Request processed in 43us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787405.694348:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1787787405.694374:0:10776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694485888 00000100:00100000:0.0:1787787405.694377:0:10776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694485888 00000100:00100000:0.0:1787787405.694411:0:10776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787787405.694417:0:10776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06025c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694485888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787405.694468:0:10776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06025c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694485888:12345-0@lo:400:kworker.0 Request processed in 50us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787405.694474:0:10776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787787405.694500:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694485248:0@lo:400:kworker.0 00000100:00100000:0.0:1787787405.694510:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e4bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694485888:0@lo:400:kworker.0 00000100:00080000:2.0:1787787405.694586:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787787405.694591:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787405.694622:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1874630694485504:0@lo:400:kworker.0 00010000:00010000:3.0:1787787405.948621:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787406.204663:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07377e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694486016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787406.204731:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787406.204853:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694486016 00000100:00100000:1.0:1787787406.204860:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694486016 00000100:00100000:1.0:1787787406.204911:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787787406.204921:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06020ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694486016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787787406.204953:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787787406.205013:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06020ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694486016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787406.205020:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787787406.205235:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07377e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694486016:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1787787406.256897:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00100000:3.0:1787787406.256916:0:5842:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c5599457-aa74-4a71-951f-faabe33e6ec7 00000001:00080000:3.0:1787787406.256931:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1787787406.256948:0:5842:0:(genops.c:885:class_export_put()) final put ffff9d073ff90000/c5599457-aa74-4a71-951f-faabe33e6ec7 00000020:00000080:3.0:1787787406.256973:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d073ff90000/c5599457-aa74-4a71-951f-faabe33e6ec7 for lustre-MDT0000 00000020:00000080:3.0:1787787406.257034:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d073ff97000 for lustre-MDT0000 00000001:00100000:3.0:1787787406.278237:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c5599457-aa74-4a71-951f-faabe33e6ec7 00000020:00000080:3.0:1787787406.278246:0:6697:0:(genops.c:885:class_export_put()) final put ffff9d07055ec800/c5599457-aa74-4a71-951f-faabe33e6ec7 00000020:00000080:3.0:1787787406.278271:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d07055ec800/c5599457-aa74-4a71-951f-faabe33e6ec7 for lustre-OST0000 00000020:00000080:3.0:1787787406.278326:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d07055e9800 for lustre-OST0000 00000100:00100000:3.0:1787787406.338809:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787406.338862:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787406.338896:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678780800 00000100:00100000:3.0:1787787406.338908:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787406.338913:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678780800 00000100:00100000:0.0:1787787406.340802:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678781056 00000100:00100000:0.0:1787787406.340822:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678781056 00000100:00100000:0.0:1787787406.340857:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678780928 00000100:00100000:0.0:1787787406.340860:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678780928 00000100:00100000:0.0:1787787406.340881:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 21 00000100:00100000:0.0:1787787406.340890:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1221c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+12:2344:x1874630678780800:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787406.340908:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787406.340926:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0708771c00/0xdeb1953cba4b112c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34fbb expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787406.340943:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787406.341000:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1221c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+11:2344:x1874630678780800:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 112us (2205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787406.341007:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 21 00000100:00100000:0.0:1787787406.341040:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 22 00000100:00100000:0.0:1787787406.341047:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705815c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+10:2344:x1874630678781056:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787406.341056:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787406.341066:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d073fd38e00/0xdeb1953cba4b12f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3506a expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787406.341075:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787406.341093:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705815c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+9:2344:x1874630678781056:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 48us (2233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787406.341099:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 22 00000100:00100000:0.0:1787787406.341147:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 23 00000100:00100000:0.0:1787787406.341152:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b120f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+8:2344:x1874630678780928:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787406.341159:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787406.341168:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0708770e00/0xdeb1953cba4b1133 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34fe5 expref: 8 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787406.341176:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787406.341191:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b120f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af6a8f90-14b7-42f3-a06a-560ac8c8f006+7:2344:x1874630678780928:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 38us (2287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787406.341197:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 23 00000100:00100000:3.0:1787787406.344261:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787406.344399:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678781312 00000100:00100000:2.0:1787787406.344413:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678781312 00000100:00080000:0.0:1787787406.344514:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787406.344598:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 241 00000100:00100000:2.0:1787787406.344612:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267c8212-9bde-4b8e-bca1-0730dc2554b7+6:2341:x1874630678781312:12345-192.168.206.10@tcp:39:umount.0 00000020:00000080:2.0:1787787406.344665:0:5821:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b1141 00000020:00010000:2.0:1787787406.344676:0:5821:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9d070721a000: total 0 00000100:00080000:2.0:1787787406.344682:0:5821:0:(import.c:65:import_set_state_nolock()) ffff9d0707219800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787787406.344719:0:5821:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1787787406.345251:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:267c8212-9bde-4b8e-bca1-0730dc2554b7+5:2341:x1874630678781312:12345-192.168.206.10@tcp:39:umount.0 Request processed in 638us (1702us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1787787406.345262:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 241 00000020:00010000:0.0:1787787406.345392:0:8440:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9d070721a000: total 0 00010000:00010000:0.0:1787787406.345497:0:8440:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9d070721a000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787787406.345540:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d071b71d300) 00010000:00010000:0.0:1787787406.345543:0:8440:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787787406.345554:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b206e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3541b expref: 4 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787406.345603:0:8440:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9d070721a000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1787787406.345617:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787406.345619:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787406.345621:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787406.362158:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787406.362322:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678781568 00000100:00100000:2.0:1787787406.362335:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678781568 00000100:00100000:2.0:1787787406.362400:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 297 00000100:00100000:2.0:1787787406.362410:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+7:2341:x1874630678781568:12345-192.168.206.10@tcp:251:umount.0 00000020:00000080:2.0:1787787406.362508:0:5813:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b1037 00000020:00010000:2.0:1787787406.362517:0:5813:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9d073472d800: total 0 00000100:00080000:2.0:1787787406.362522:0:5813:0:(import.c:65:import_set_state_nolock()) ffff9d073472a800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787787406.362607:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6a8f90-14b7-42f3-a06a-560ac8c8f006+3:2341:x1874630678781568:12345-192.168.206.10@tcp:251:umount.0 Request processed in 198us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787406.362634:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 297 00000020:00010000:3.0:1787787406.363250:0:8439:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9d073472d800: total 0 00010000:00010000:3.0:1787787406.363257:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787406.363319:0:8439:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9d073472d800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787787406.363361:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d072212b400/0xdeb1953cba4b10ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c34fad expref: 2 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787406.363376:0:8439:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9d073472d800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1787787406.363386:0:8439:0:(genops.c:885:class_export_put()) final put ffff9d073472d800/af6a8f90-14b7-42f3-a06a-560ac8c8f006 00010000:00010000:3.0:1787787406.363492:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787406.363495:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787406.363497:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787787406.369145:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d073472d800/af6a8f90-14b7-42f3-a06a-560ac8c8f006 for MGS 00000020:00000080:0.0:1787787406.369237:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d073472a800 for MGS 00010000:00010000:0.0:1787787406.972606:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787407.230092:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06020eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694486144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787407.230158:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787407.234327:0:12107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694486144 00000100:00100000:2.0:1787787407.234401:0:12107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694486144 00000100:00100000:2.0:1787787407.234482:0:12107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787787407.234494:0:12107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694486144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787787407.234594:0:12107:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787407.234673:0:12107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694486144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 182us (4513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787407.234681:0:12107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1787787407.234704:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787407.234744:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06020eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694486144:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1787787407.420750:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787787407.420760:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787787407.423801:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1787787407.423813:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787787408.000976:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787787408.059111:0:13061:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787787408.074664:0:13061:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1787787408.074709:0:13061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0708770c00/0xdeb1953cba4b10bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b10c3 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787408.074723:0:13061:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0708770c00/0xdeb1953cba4b10bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b10c3 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787408.074731:0:13061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0708770c00/0xdeb1953cba4b10bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xdeb1953cba4b10c3 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787408.074738:0:13061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff9d0708770c00/0xdeb1953cba4b10bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xdeb1953cba4b10c3 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787408.074829:0:13061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787787408.074834:0:13061:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787787408.074857:0:13061:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787787408.074862:0:13061:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787787408.074867:0:13061:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787787408.074891:0:13061:0:(import.c:65:import_set_state_nolock()) ffff9d072dfb0800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787787408.075155:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1874630694486272:0@lo:39:umount.0 00000100:00100000:3.0:1787787408.075220:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787408.075349:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694486272 00000100:00100000:1.0:1787787408.075356:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694486272 00000100:00100000:1.0:1787787408.075404:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787787408.075414:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705974f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1874630694486272:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787787408.075461:0:9687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b0e46 00000100:00080000:1.0:1787787408.075470:0:9687:0:(import.c:65:import_set_state_nolock()) ffff9d073ca2d000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787787408.075625:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787408.075633:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d0708770c00/0xdeb1953cba4b10bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xdeb1953cba4b10c3 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787408.075641:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708770c00 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:0.0:1787787408.075645:0:8440:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d0708770c00/0xdeb1953cba4b10bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xdeb1953cba4b10c3 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787408.075654:0:8440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d0708770c00/0xdeb1953cba4b10bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xdeb1953cba4b10c3 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787787408.075660:0:8440:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d0708770c00/0xdeb1953cba4b10bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xdeb1953cba4b10c3 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787408.075667:0:8440:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787787408.075669:0:8440:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787787408.075672:0:8440:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787787408.075696:0:8440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d0708770c00/0xdeb1953cba4b10bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdeb1953cba4b10c3 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787408.075702:0:8440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787787408.075753:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1787787408.075771:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d0708770c00/0xdeb1953cba4b10bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdeb1953cba4b10c3 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787408.075779:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d0708770c00/0xdeb1953cba4b10bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdeb1953cba4b10c3 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787408.075790:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787408.075792:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787408.075794:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787408.075936:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705974f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3290:x1874630694486272:12345-0@lo:39:umount.0 Request processed in 522us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787408.075944:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1787787408.075953:0:9687:0:(genops.c:885:class_export_put()) final put ffff9d073ca2e800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:2.0:1787787408.076176:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9d072dfb0800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787787408.076187:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1874630694486272:0@lo:39:umount.0 00000100:00080000:2.0:1787787408.076208:0:13061:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787787408.076210:0:13061:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787787408.076214:0:13061:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787787408.077228:0:13061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d072212be00/0xdeb1953cba4b10ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b10d1 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787408.077243:0:13061:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d072212be00/0xdeb1953cba4b10ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b10d1 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787408.077250:0:13061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d072212be00/0xdeb1953cba4b10ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xdeb1953cba4b10d1 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787408.077256:0:13061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff9d072212be00/0xdeb1953cba4b10ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xdeb1953cba4b10d1 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787408.077340:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06020eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694486400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787787408.077388:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1787787408.077456:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d073ca2e800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787787408.077504:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d073ca2d000 for lustre-MDT0000 00000100:00100000:3.0:1787787408.077520:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694486400 00000100:00100000:3.0:1787787408.077526:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694486400 00000100:00100000:3.0:1787787408.077566:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787787408.077573:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705975a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1500c007-b35b-4004-b231-bb5a7ec082ef+19:3292:x1874630694486400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787787408.077585:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787408.077601:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0700031800/0xdeb1953cba4b10c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdeb1953cba4b10bc expref: 19 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787408.077614:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787408.077646:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705975a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1500c007-b35b-4004-b231-bb5a7ec082ef+18:3292:x1874630694486400:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787408.077653:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787787408.077688:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06020eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694486400:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787787408.077934:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787408.077940:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d072212be00/0xdeb1953cba4b10ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xdeb1953cba4b10d1 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787408.077948:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212be00 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:0.0:1787787408.077951:0:8439:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d072212be00/0xdeb1953cba4b10ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xdeb1953cba4b10d1 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787408.077959:0:8439:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d072212be00/0xdeb1953cba4b10ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xdeb1953cba4b10d1 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787787408.077966:0:8439:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d072212be00/0xdeb1953cba4b10ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xdeb1953cba4b10d1 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787408.077972:0:8439:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787787408.077975:0:8439:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1787787408.078029:0:8439:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d072212be00/0xdeb1953cba4b10ca lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdeb1953cba4b10d1 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787408.078035:0:8439:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787787408.078059:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d072212be00/0xdeb1953cba4b10ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdeb1953cba4b10d1 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787408.078090:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787408.078092:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787408.078094:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787408.078101:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787787408.078110:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06020eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694486528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787787408.078140:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787408.078173:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694486528 00000100:00100000:0.0:1787787408.078177:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694486528 00000100:00100000:0.0:1787787408.078204:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787787408.078211:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070303d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1500c007-b35b-4004-b231-bb5a7ec082ef+18:3291:x1874630694486528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787787408.078220:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787408.078230:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0708770a00/0xdeb1953cba4b10d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdeb1953cba4b10ca expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787408.078239:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787408.078265:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070303d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1500c007-b35b-4004-b231-bb5a7ec082ef+17:3291:x1874630694486528:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787408.078282:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787787408.078310:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06020eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694486528:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787787408.078568:0:13061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787787408.078575:0:13061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d072212be00/0xdeb1953cba4b10ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdeb1953cba4b10d1 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787408.078599:0:13061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0700030a00/0xdeb1953cba4b0ff1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0ff8 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787408.078606:0:13061:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0700030a00/0xdeb1953cba4b0ff1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b0ff8 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787408.078612:0:13061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0700030a00/0xdeb1953cba4b0ff1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdeb1953cba4b0ff8 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787408.078618:0:13061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff9d0700030a00/0xdeb1953cba4b0ff1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdeb1953cba4b0ff8 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787408.078684:0:13061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787787408.078690:0:13061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0708771600/0xdeb1953cba4b12e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b12ec expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787408.078697:0:13061:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0708771600/0xdeb1953cba4b12e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b12ec expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787408.078703:0:13061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0708771600/0xdeb1953cba4b12e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdeb1953cba4b12ec expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787408.078709:0:13061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff9d0708771600/0xdeb1953cba4b12e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdeb1953cba4b12ec expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787408.078770:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787787408.078776:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d0700030a00/0xdeb1953cba4b0ff1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdeb1953cba4b0ff8 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787408.078782:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0700030a00 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:3.0:1787787408.078785:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d0700030a00/0xdeb1953cba4b0ff1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdeb1953cba4b0ff8 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787408.078791:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d0700030a00/0xdeb1953cba4b0ff1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xdeb1953cba4b0ff8 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787787408.078807:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d0700030a00/0xdeb1953cba4b0ff1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xdeb1953cba4b0ff8 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787408.078812:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787787408.078815:0:5809:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787787408.078817:0:5809:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787787408.078832:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d0700030a00/0xdeb1953cba4b0ff1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdeb1953cba4b0ff8 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787408.078838:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787787408.078865:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d0700030a00/0xdeb1953cba4b0ff1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdeb1953cba4b0ff8 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787408.078872:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d0700030a00/0xdeb1953cba4b0ff1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdeb1953cba4b0ff8 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787408.078885:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787408.078888:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d0708771600/0xdeb1953cba4b12e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdeb1953cba4b12ec expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787408.078893:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708771600 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:3.0:1787787408.078896:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d0708771600/0xdeb1953cba4b12e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdeb1953cba4b12ec expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787408.078903:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d0708771600/0xdeb1953cba4b12e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdeb1953cba4b12ec expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787408.078984:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07059761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694486656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787787408.079027:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1787787408.079123:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d0708771600/0xdeb1953cba4b12e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdeb1953cba4b12ec expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787408.079140:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787787408.079142:0:5809:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1787787408.079156:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d0708771600/0xdeb1953cba4b12e5 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdeb1953cba4b12ec expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787408.079162:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787787408.079179:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d0708771600/0xdeb1953cba4b12e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdeb1953cba4b12ec expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787408.079188:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787408.079190:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787408.079192:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787408.079202:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07059770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694486784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787787408.079227:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787408.079256:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694486656 00000100:00100000:3.0:1787787408.079260:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694486656 00000100:00100000:3.0:1787787408.079301:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694486784 00000100:00100000:3.0:1787787408.079305:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694486784 00000100:00100000:3.0:1787787408.079323:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787787408.079329:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+18:3293:x1874630694486656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787787408.079339:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787408.079349:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0701647400/0xdeb1953cba4b0ff8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdeb1953cba4b0ff1 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787408.079362:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787408.079388:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+17:3293:x1874630694486656:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787408.079393:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787787408.079413:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787787408.079419:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705975680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+16:3294:x1874630694486784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787787408.079426:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787408.079434:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d070141e800/0xdeb1953cba4b12ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdeb1953cba4b12e5 expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787408.079645:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787408.079674:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705975680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+15:3294:x1874630694486784:12345-0@lo:103:ldlm_bl.0 Request processed in 255us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787408.079680:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787787408.079814:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07059770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694486784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787787408.079930:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07059761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1500c007-b35b-4004-b231-bb5a7ec082ef:3293:1874630694486656:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787787408.080128:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787408.080230:0:13061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787787408.080238:0:13061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d0708771600/0xdeb1953cba4b12e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdeb1953cba4b12ec expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787408.080261:0:13061:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787787408.080281:0:13061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0700031000/0xdeb1953cba4b0da5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b0dac expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787408.080289:0:13061:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0700031000/0xdeb1953cba4b0da5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b0dac expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787408.080296:0:13061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0700031000/0xdeb1953cba4b0da5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdeb1953cba4b0dac expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787408.080301:0:13061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff9d0700031000/0xdeb1953cba4b0da5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdeb1953cba4b0dac expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787408.080328:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787408.080333:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d0700031000/0xdeb1953cba4b0da5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdeb1953cba4b0dac expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787408.080340:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0700031000 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:0.0:1787787408.080342:0:8440:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d0700031000/0xdeb1953cba4b0da5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdeb1953cba4b0dac expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787408.080355:0:8440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d0700031000/0xdeb1953cba4b0da5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xdeb1953cba4b0dac expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787787408.080361:0:8440:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d0700031000/0xdeb1953cba4b0da5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xdeb1953cba4b0dac expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787408.080366:0:8440:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787787408.080368:0:8440:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:0.0:1787787408.080386:0:8440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d0700031000/0xdeb1953cba4b0da5 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdeb1953cba4b0dac expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787408.080391:0:8440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787787408.080417:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d0700031000/0xdeb1953cba4b0da5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdeb1953cba4b0dac expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787408.080426:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787408.080427:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787408.080429:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787408.080490:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d070303cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694486912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787787408.080525:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787408.080601:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694486912 00000100:00100000:0.0:1787787408.080606:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694486912 00000100:00100000:0.0:1787787408.080647:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787787408.080654:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+15:3291:x1874630694486912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787787408.080663:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787408.080673:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0701646200/0xdeb1953cba4b0dac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdeb1953cba4b0da5 expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787408.080689:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787408.080720:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1500c007-b35b-4004-b231-bb5a7ec082ef+14:3291:x1874630694486912:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787408.080736:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787787408.080766:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d070303cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694486912:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787787408.080998:0:13061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787787408.081004:0:13061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d0700031000/0xdeb1953cba4b0da5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdeb1953cba4b0dac expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787408.081017:0:13061:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:2.0:1787787408.081020:0:13061:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1787787408.081022:0:13061:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1787787408.081049:0:13061:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1787787408.081054:0:13061:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1787787408.081057:0:13061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787787408.081062:0:13061:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:2.0:1787787408.081068:0:13061:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9d0708b6c000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787787408.081073:0:13061:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9d073763d800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787787408.081080:0:13061:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9d070721a000 267c8212-9bde-4b8e-bca1-0730dc2554b7 192.168.206.10@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787787408.081084:0:13061:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9d0706a2cd28) has exports, disconnecting them 00000020:00080000:2.0:1787787408.081094:0:13061:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9d0708b6c000), last request at 1787787405 00000020:00000080:2.0:1787787408.081102:0:13061:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b0fb9 00000100:00080000:2.0:1787787408.081122:0:13061:0:(import.c:65:import_set_state_nolock()) ffff9d0708b6c800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787787408.081207:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787787408.081308:0:13061:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d0708b6c000): rc 0 00000020:00000080:2.0:1787787408.081311:0:13061:0:(genops.c:885:class_export_put()) final put ffff9d0708b6c000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1787787408.081329:0:13061:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9d073763d800), last request at 1787787405 00000020:00000080:2.0:1787787408.081332:0:13061:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b0ee0 00000100:00080000:2.0:1787787408.081338:0:13061:0:(import.c:65:import_set_state_nolock()) ffff9d073763e000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1787787408.081375:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0708b6c000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787787408.081417:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d0708b6c800 for lustre-MDT0000 00010000:00010000:3.0:1787787408.081603:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787787408.081717:0:13061:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d073763d800): rc 0 00000020:00000080:2.0:1787787408.081719:0:13061:0:(genops.c:885:class_export_put()) final put ffff9d073763d800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1787787408.081736:0:13061:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb6cdc48a3ae0 00000100:00080000:2.0:1787787408.081755:0:13061:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787787408.081758:0:13061:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1787787408.081771:0:13061:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787787408.081825:0:13061:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787787408.081839:0:13061:0:(import.c:65:import_set_state_nolock()) ffff9d07078ba000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787787408.081853:0:13061:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787787408.081855:0:13061:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1787787408.081863:0:13061:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:3.0:1787787408.082050:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d073763d800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787787408.082089:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d073763e000 for lustre-MDT0000 00010000:00010000:0.0:1787787408.082118:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787408.082177:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1874630694487040:0@lo:9:umount.0 00000100:00100000:2.0:1787787408.082228:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787787408.082316:0:13061:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787787408.082328:0:13061:0:(import.c:65:import_set_state_nolock()) ffff9d073d87f000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1787787408.082368:0:13061:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9d0706a2cd28) has no exports 00000100:00100000:0.0:1787787408.082480:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1874630694487168:0@lo:9:umount.0 00000100:00100000:0.0:1787787408.082510:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787408.083581:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694487040 00000100:00100000:3.0:1787787408.083591:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694487040 00000100:00100000:3.0:1787787408.083740:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694487168 00000100:00100000:3.0:1787787408.083743:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694487168 00000100:00100000:3.0:1787787408.083774:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787787408.083781:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1874630694487040:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787787408.083802:0:6674:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b0f3b 00000100:00080000:3.0:1787787408.083809:0:6674:0:(import.c:65:import_set_state_nolock()) ffff9d0734131000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787787408.083836:0:6674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1787787408.084066:0:10776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787787408.084074:0:10776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070303cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3290:x1874630694487168:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787787408.084086:0:10776:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b1022 00000100:00080000:1.0:1787787408.084091:0:10776:0:(import.c:65:import_set_state_nolock()) ffff9d073762f000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787787408.084111:0:10776:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1787787408.084234:0:10776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070303cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3290:x1874630694487168:12345-0@lo:9:umount.0 Request processed in 162us (1723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787408.084241:0:10776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787787408.084695:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3290:x1874630694487040:12345-0@lo:9:umount.0 Request processed in 912us (2464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787408.084702:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1787787408.084854:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787787408.084868:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787787408.085416:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9d073d87f000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787787408.085454:0:3290:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787787408.085456:0:3290:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787787408.085461:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1874630694487168:0@lo:9:umount.0 00000100:00080000:0.0:1787787408.085476:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9d07078ba000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787787408.085485:0:3290:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787787408.085486:0:3290:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787787408.085489:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1874630694487040:0@lo:9:umount.0 00010000:00010000:0.0:1787787408.085518:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787787408.091677:0:13061:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9d0706a2cd28) has no exports 00000020:00000080:1.0:1787787408.125589:0:13061:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b0e00 00000020:00000080:1.0:1787787408.125605:0:13061:0:(genops.c:885:class_export_put()) final put ffff9d072dfc7800/lustre-QMT0000_UUID 00000020:01000000:1.0:1787787408.125673:0:13061:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1787787408.126519:0:13061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787787408.126530:0:13061:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787787408.126534:0:13061:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9d07092dcd28) has no exports 00000020:00000080:1.0:1787787408.127609:0:13061:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b0df9 00000020:00000080:1.0:1787787408.127618:0:13061:0:(genops.c:885:class_export_put()) final put ffff9d073d879000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787787408.127673:0:13061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787787408.127690:0:13061:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787787408.131423:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9d072dfc7800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1787787408.131449:0:38:0:(genops.c:885:class_export_put()) final put ffff9d073d87c000/lustre-QMT0000_UUID 00000020:00000080:3.0:1787787408.131452:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9d073d87c000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1787787408.131457:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1787787408.131594:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9d073d879000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000001:00100000:3.0:1787787408.819281:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787787408.819290:0:7630:0:(genops.c:885:class_export_put()) final put ffff9d073762a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787787408.819356:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9d073762a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000001:00100000:3.0:1787787408.819805:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c5599457-aa74-4a71-951f-faabe33e6ec7 00000020:00000080:3.0:1787787408.819809:0:7630:0:(genops.c:885:class_export_put()) final put ffff9d0734165800/c5599457-aa74-4a71-951f-faabe33e6ec7 00000020:00000080:1.0:1787787408.819902:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d073762f000 for lustre-OST0001 00000020:00000080:1.0:1787787408.819970:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0734165800/c5599457-aa74-4a71-951f-faabe33e6ec7 for lustre-OST0001 00000020:00000080:1.0:1787787408.820067:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d0734166000 for lustre-OST0001 00010000:00010000:3.0:1787787409.021281:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787410.044770:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787410.814952:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1874630694487552:0@lo:400:kworker.0 00000100:00100000:1.0:1787787410.815030:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787410.815092:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787787410.815099:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07377e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1874630694487424:0@lo:400:kworker.0 00000100:00100000:1.0:1787787410.815122:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787410.815150:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694487552 00000100:00100000:1.0:1787787410.815156:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694487552 00000100:00100000:1.0:1787787410.815187:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694487424 00000100:00100000:1.0:1787787410.815190:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694487424 00000100:00100000:1.0:1787787410.815206:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787787410.815214:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3294:x1874630694487552:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787787410.815221:0:5820:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787787410.815271:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3294:x1874630694487552:12345-0@lo:400:kworker.0 Request processed in 56us (241us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787787410.815278:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787787410.815296:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787787410.815313:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3294:x1874630694487424:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787787410.815319:0:5820:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787787410.815344:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3294:x1874630694487424:12345-0@lo:400:kworker.0 Request processed in 30us (221us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787787410.815349:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:1.0:1787787410.815387:0:3294:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787787410.815392:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9d073763d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787787410.815396:0:3294:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1787787410.815920:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787787410.815935:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07377e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694487296:0@lo:400:kworker.0 00000100:00100000:0.0:1787787410.815986:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787410.816026:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694487296 00000100:00100000:3.0:1787787410.816032:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694487296 00000100:00100000:3.0:1787787410.816078:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1787787410.816088:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0703092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+14:3291:x1874630694487296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787410.816141:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0703092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1500c007-b35b-4004-b231-bb5a7ec082ef+14:3291:x1874630694487296:12345-0@lo:400:kworker.0 Request processed in 55us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787410.816147:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1787787410.816184:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07377e70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1500c007-b35b-4004-b231-bb5a7ec082ef:3291:1874630694487296:0@lo:400:kworker.0 00000100:00080000:1.0:1787787410.836099:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9d073763d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787787410.836112:0:3294:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 129 00000100:00080000:1.0:1787787410.836121:0:3294:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d073763d000 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:1.0:1787787410.836157:0:3294:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0707a0a580 x1874630694487680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787787410.836237:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3290:1874630694487680:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787787410.836317:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787410.836498:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694487680 00000100:00100000:2.0:1787787410.836507:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694487680 00000100:00100000:2.0:1787787410.836565:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787787410.836572:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d070303fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3290:x1874630694487680:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1787787410.836602:0:5820:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787787410.836704:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07377e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1874630694487424:0@lo:400:kworker.0 00000100:00080000:1.0:1787787410.836996:0:3294:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787787410.837000:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9d073472e000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787787410.837004:0:3294:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787787410.837007:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9d073472e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787787410.837011:0:3294:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 147 00000100:00080000:1.0:1787787410.837016:0:3294:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d073472e000 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:1.0:1787787410.837033:0:3294:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0707a0b480 x1874630694487808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787787410.838670:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3290:1874630694487808:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787787410.838738:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787410.838828:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1874630694487552:0@lo:400:kworker.0 00000100:00100000:3.0:1787787410.839467:0:9687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694487808 00000100:00100000:3.0:1787787410.839475:0:9687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694487808 00000100:00100000:3.0:1787787410.839561:0:9687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787787410.839568:0:9687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3290:x1874630694487808:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1787787410.839584:0:9687:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787787410.839645:0:9687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3290:x1874630694487808:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 76us (907us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787787410.839652:0:9687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:1.0:1787787410.839715:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9d073472e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787787410.839721:0:3290:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787787410.839724:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3290:1874630694487808:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1787787410.851957:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d070303fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3290:x1874630694487680:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 15376us (15631us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787787410.851972:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:0.0:1787787410.852063:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9d073763d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787787410.852070:0:3290:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787787410.852090:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3290:1874630694487680:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:3.0:1787787411.068691:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787787411.373183:0:5842:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 267c8212-9bde-4b8e-bca1-0730dc2554b7 00000001:00080000:0.0:1787787411.373197:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1787787411.373202:0:5842:0:(genops.c:885:class_export_put()) final put ffff9d070721a000/267c8212-9bde-4b8e-bca1-0730dc2554b7 00000020:00000080:0.0:1787787411.373229:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9d070721a000/267c8212-9bde-4b8e-bca1-0730dc2554b7 for lustre-MDT0000 00000020:00000080:0.0:1787787411.373589:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d0707219800 for lustre-MDT0000 00000001:00100000:3.0:1787787411.409924:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787787411.409934:0:6697:0:(genops.c:885:class_export_put()) final put ffff9d0734131800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787787411.410049:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0734131800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787787411.410102:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d0734131000 for lustre-OST0000 00010000:00010000:0.0:1787787412.094415:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787413.117822:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787414.141074:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787787414.205120:0:13061:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d073d9bbea0 - data ffff9d0737cba1b0/ffff9d07378c2000 00000020:01000000:1.0:1787787414.205266:0:13061:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d0707d77f00 - data ffff9d07397c7a20/ffff9d07093cb400 00000001:00000004:1.0:1787787414.215953:0:13061:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1787787414.274254:0:13061:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787787414.274263:0:13061:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1787787414.274525:0:13061:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787787414.274528:0:13061:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787787414.275198:0:6714:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787787414.275203:0:6714:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1787787414.275213:0:6714:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1787787414.276125:0:13061:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787787414.276131:0:13061:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1787787414.276157:0:13061:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787787414.276159:0:13061:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787787414.276515:0:7977:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787787414.276520:0:7977:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:3.0:1787787414.276529:0:7977:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1787787414.319503:0:13061:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b0dc8 00000020:00000080:2.0:1787787414.319515:0:13061:0:(genops.c:885:class_export_put()) final put ffff9d072dfb4000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787787414.320622:0:13061:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b0ddd 00000020:00000080:2.0:1787787414.320632:0:13061:0:(genops.c:885:class_export_put()) final put ffff9d072dfc6800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787787414.320639:0:13061:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787787414.320645:0:13061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787787414.320654:0:13061:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787787414.320658:0:13061:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9d0706a299b8) has no exports 00000004:01000000:2.0:1787787414.320800:0:13061:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787787414.320808:0:13061:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b101b 00000020:00000080:2.0:1787787414.320812:0:13061:0:(genops.c:885:class_export_put()) final put ffff9d07185aa800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787787414.320816:0:13061:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787787414.320820:0:13061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787787414.320825:0:13061:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787787414.320828:0:13061:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9d07092db370) has no exports 00000020:00000080:2.0:1787787414.320833:0:13061:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b1014 00000020:00000080:2.0:1787787414.320836:0:13061:0:(genops.c:885:class_export_put()) final put ffff9d073d87e000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1787787414.321149:0:13061:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787787414.321154:0:13061:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787787414.321158:0:13061:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1787787414.321164:0:13061:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787787414.321166:0:13061:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787787414.321195:0:13061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787787414.321201:0:13061:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787787414.321206:0:13061:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b0f26 00000020:00000080:2.0:1787787414.321210:0:13061:0:(genops.c:885:class_export_put()) final put ffff9d0708b6b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787787414.321214:0:13061:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787787414.321224:0:13061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787787414.321228:0:13061:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787787414.321230:0:13061:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9d072dfb99b8) has no exports 00000020:00000080:2.0:1787787414.321245:0:13061:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b0f1f 00000020:00000080:2.0:1787787414.321249:0:13061:0:(genops.c:885:class_export_put()) final put ffff9d07078b9800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1787787414.321568:0:13061:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787787414.321571:0:13061:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787787414.321574:0:13061:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:2.0:1787787414.321577:0:13061:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787787414.321578:0:13061:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787787414.321599:0:13061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787787414.321603:0:13061:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787787414.321625:0:13061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787787414.321628:0:13061:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787787414.321652:0:13061:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b0de4 00000020:00000080:2.0:1787787414.321656:0:13061:0:(genops.c:885:class_export_put()) final put ffff9d072dfc3000/lustre-MDD0000_UUID 00000020:01000000:2.0:1787787414.321660:0:13061:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787787414.321664:0:13061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787787414.321667:0:13061:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787787414.321669:0:13061:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9d072dfbcd28) has no exports 00000020:00000080:2.0:1787787414.321683:0:13061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787787414.321685:0:13061:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787787414.321688:0:13061:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b0deb 00000020:00000080:2.0:1787787414.321690:0:13061:0:(genops.c:885:class_export_put()) final put ffff9d072dfc2800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787787414.321698:0:13061:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d0722109800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787787414.321701:0:13061:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d0722109800 3 00000020:01000004:2.0:1787787414.321704:0:13061:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d0722109800 from lustre-MDT0000 00000020:00000080:2.0:1787787414.321717:0:13061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787787414.321720:0:13061:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787787414.321722:0:13061:0:(genops.c:885:class_export_put()) final put ffff9d072dfb7000/lustre-MDT0000_UUID 00000020:00000080:2.0:1787787414.321725:0:13061:0:(genops.c:844:class_export_destroy()) destroying export ffff9d072dfb7000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787787414.321732:0:13061:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787787414.321790:0:13061:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1787787414.321794:0:13061:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787787414.321796:0:13061:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787787414.321799:0:13061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787787414.321802:0:13061:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787787414.321808:0:13061:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9d0702c04800 1500c007-b35b-4004-b231-bb5a7ec082ef 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787787414.321813:0:13061:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9d0706a28000) has exports, disconnecting them 00000020:00080000:2.0:1787787414.321817:0:13061:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9d0702c04800), last request at 1787787201 00000020:00000080:2.0:1787787414.321830:0:13061:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b0d89 00000020:00010000:2.0:1787787414.321834:0:13061:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9d0702c04800: total 8 00000100:00080000:2.0:1787787414.321837:0:13061:0:(import.c:65:import_set_state_nolock()) ffff9d0702c00000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787787414.321853:0:13061:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d0702c04800): rc 0 00000020:00080000:2.0:1787787414.321857:0:13061:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9d0706a28000) has no exports 00000100:00100000:2.0:1787787414.321940:0:5812:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9d0706a33800:5812] 0 exiting: rc = 1 00000100:00100000:2.0:1787787414.322002:0:5814:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9d0707af9600:5814] 2 exiting: rc = 0 00000020:00000080:0.0:1787787414.322161:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d072dfb4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787787414.322174:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d072dfc6800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1787787414.322177:0:8:0:(genops.c:885:class_export_put()) final put ffff9d072dfb5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787787414.322179:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d072dfb5000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787787414.322182:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787787414.322299:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d07185aa800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787787414.322303:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d073d87e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787787414.322311:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d073d87f000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787787414.322315:0:8:0:(genops.c:885:class_export_put()) final put ffff9d0708b6d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787787414.322317:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0708b6d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787787414.322326:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787787414.322356:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0708b6b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787787414.322361:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d07078b9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787787414.322366:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d07078ba000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787787414.322370:0:8:0:(genops.c:885:class_export_put()) final put ffff9d073ff94800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787787414.322371:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d073ff94800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787787414.322374:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787787414.322494:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d072dfc3000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1787787414.322497:0:8:0:(genops.c:885:class_export_put()) final put ffff9d072dfb6000/lustre-MDD0000_UUID 00000020:00000080:0.0:1787787414.322499:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d072dfb6000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1787787414.322503:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1787787414.322643:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d072dfc2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1787787414.322671:0:5813:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9d0708b1c800:5813] 1 exiting: rc = 0 00000020:00010000:3.0:1787787414.322777:0:8440:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9d0702c04800: total 0 00010000:00010000:3.0:1787787414.322803:0:8440:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9d0702c04800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1787787414.322828:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0708771a00/0xdeb1953cba4b10df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdeb1953cba4b10d8 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787414.322843:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d073fd39c00/0xdeb1953cba4b12de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdeb1953cba4b12d7 expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787414.322852:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0701647200/0xdeb1953cba4b0e93 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdeb1953cba4b0e8c expref: 7 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787414.322865:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0700030000/0xdeb1953cba4b108b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdeb1953cba4b1084 expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787414.322886:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0701646e00/0xdeb1953cba4b10a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdeb1953cba4b10a0 expref: 5 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787414.322897:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0700030400/0xdeb1953cba4b1099 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdeb1953cba4b1092 expref: 4 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787414.322906:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d070141fe00/0xdeb1953cba4b12d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdeb1953cba4b12c9 expref: 3 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787414.322930:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d072212a000/0xdeb1953cba4b10b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdeb1953cba4b10ae expref: 2 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787414.322939:0:8440:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9d0702c04800, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1787787414.322951:0:8440:0:(genops.c:885:class_export_put()) final put ffff9d0702c04800/1500c007-b35b-4004-b231-bb5a7ec082ef 00010000:00010000:3.0:1787787414.322963:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787414.322965:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787414.322966:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787787414.322971:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0702c04800/1500c007-b35b-4004-b231-bb5a7ec082ef for MGS 00000020:00000080:3.0:1787787414.322998:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d0702c00000 for MGS 00000100:00100000:2.0:1787787414.323215:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323224:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323229:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323246:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323251:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323256:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323261:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323267:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323272:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323277:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323557:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323567:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323572:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323577:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323583:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323589:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323595:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323600:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323614:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323620:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323626:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323631:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323636:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323642:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323647:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323652:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323658:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323664:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323669:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323674:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323679:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323684:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323690:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323697:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323702:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323707:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323712:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323717:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323722:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323728:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323734:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323739:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323744:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323749:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323755:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323760:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323766:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323772:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323777:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323783:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323788:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323794:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323798:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323811:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323816:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323822:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323829:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323834:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323840:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323844:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323850:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323855:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323860:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787414.323865:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1787787414.324427:0:13061:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787787414.324431:0:13061:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1787787414.325619:0:13061:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d07058b88a0 - data ffff9d0737c4a5e8/ffff9d073767e400 00000020:01000000:2.0:1787787414.325751:0:13061:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d0707a4eb40 - data ffff9d07397bdca8/ffff9d07031cfc00 00000020:00000080:2.0:1787787414.326285:0:13061:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b0d6d 00000020:00000080:2.0:1787787414.326293:0:13061:0:(genops.c:885:class_export_put()) final put ffff9d0707de6800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787787414.326348:0:13061:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d0722109800 from MGS, refs=2 00000020:01000004:2.0:1787787414.326351:0:13061:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d0722109800 2 00000020:01000004:2.0:1787787414.326354:0:13061:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d0722109800 from MGS 00000020:00000080:2.0:1787787414.326375:0:13061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787787414.326380:0:13061:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1787787414.326383:0:13061:0:(genops.c:885:class_export_put()) final put ffff9d0707de1000/MGS 00000020:00000080:2.0:1787787414.326385:0:13061:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0707de1000/MGS for MGS 00000020:01000000:2.0:1787787414.326391:0:13061:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1787787414.326465:0:13061:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1787787414.326470:0:13061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787787414.326476:0:13061:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787787414.326482:0:13061:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9d072d487800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787787414.326487:0:13061:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9d072dfb8000) has exports, disconnecting them 00000020:00080000:2.0:1787787414.326491:0:13061:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9d072d487800), last request at 1787787201 00000020:00000080:2.0:1787787414.326495:0:13061:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b0e38 00000020:00080000:2.0:1787787414.326513:0:13061:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d072d487800): rc 0 00000020:00000080:2.0:1787787414.326517:0:13061:0:(genops.c:885:class_export_put()) final put ffff9d072d487800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787787414.326834:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0707de6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787787414.327505:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9d072d487800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1787787414.328487:0:13061:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1787787414.328495:0:13061:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787787414.328500:0:13061:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787787414.328506:0:13061:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787787414.328685:0:13061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787787414.328693:0:13061:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1787787414.328699:0:13061:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d0722109800 1 00000020:00000080:3.0:1787787414.328705:0:13061:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b0d5f 00000020:00000080:3.0:1787787414.328712:0:13061:0:(genops.c:885:class_export_put()) final put ffff9d0707de7800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1787787414.328717:0:13061:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1787787414.328721:0:13061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787787414.328725:0:13061:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787787414.328728:0:13061:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9d07092d99b8) has no exports 00000020:00000080:0.0:1787787414.330570:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d072dfb0800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787787414.330584:0:38:0:(genops.c:885:class_export_put()) final put ffff9d072dfb7800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787787414.330587:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9d072dfb7800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1787787414.330593:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1787787414.330648:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0707de7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787787414.354279:0:13061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787787414.354292:0:13061:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787787414.354297:0:13061:0:(genops.c:885:class_export_put()) final put ffff9d072210f000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787787414.354302:0:13061:0:(genops.c:844:class_export_destroy()) destroying export ffff9d072210f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787787414.354312:0:13061:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787787414.354429:0:13061:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9d0722108000 00000020:01000000:0.0:1787787414.354473:0:13061:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1787787414.354477:0:13061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787787414.354481:0:13061:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787787414.354485:0:13061:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9d0706a2b370) has no exports 00000100:00100000:0.0:1787787414.354568:0:5821:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9d07092f2800:5821] 2 exiting: rc = 0 00000100:00100000:3.0:1787787414.356604:0:5819:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9d07092f3200:5819] 0 exiting: rc = 1 00000100:00100000:3.0:1787787414.356690:0:9687:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9d073468f000:9687] 3 exiting: rc = 0 00000100:00100000:2.0:1787787414.357396:0:5820:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9d07031d0200:5820] 1 exiting: rc = 0 00000100:00100000:0.0:1787787414.357788:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.357795:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.357800:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.357806:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.357812:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.357819:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.357824:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.357831:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.357836:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.357840:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.357845:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.357849:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.357854:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.357859:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.357864:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.357869:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.357884:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.357891:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.357896:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.357901:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.357906:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.357911:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.357917:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.357923:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.357928:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.357934:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.357939:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.357944:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.357949:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.357955:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.357961:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.357967:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.357972:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.357978:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.357995:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.358000:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.358005:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.358010:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.358014:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.358020:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.358026:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.358031:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.358036:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.358042:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.358047:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.358053:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.358058:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.358063:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.358068:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.358073:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.358078:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.358083:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.358088:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.358093:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.358098:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.358104:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.358110:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.358115:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.358120:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.358124:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.358129:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.358134:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.358139:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.358145:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.362017:0:5822:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9d07031d0c00:5822] 0 exiting: rc = 1 00000100:00100000:1.0:1787787414.362291:0:5823:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9d07031d0e00:5823] 1 exiting: rc = 0 00000100:00100000:0.0:1787787414.362689:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362698:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362704:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362710:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362716:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362734:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362739:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362744:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362751:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362757:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362762:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362767:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362776:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362781:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362787:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362792:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362797:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362802:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362808:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362813:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362819:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362825:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362830:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362836:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362841:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362846:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362852:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362857:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362862:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362866:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362871:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362889:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362895:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362900:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362905:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362910:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362915:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362920:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362926:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362931:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362944:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362949:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362954:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362959:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362965:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362970:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362976:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362981:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362987:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362991:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.362996:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.363001:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.363006:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.363012:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.363017:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.363022:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.363027:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.363033:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.363039:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.363044:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.363049:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.363055:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.363060:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.363066:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.363619:0:5825:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9d07111dfa00:5825] 1 exiting: rc = 0 00000100:00100000:1.0:1787787414.364066:0:5824:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9d07111de400:5824] 0 exiting: rc = 1 00000100:00100000:0.0:1787787414.364368:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364375:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364382:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364388:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364396:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364402:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364408:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364414:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364421:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364469:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364477:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364489:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364495:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364501:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364506:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364512:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364518:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364523:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364529:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364535:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364541:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364560:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364570:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364575:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364581:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364586:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364591:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364596:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364608:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364614:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364620:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364634:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364640:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364664:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364674:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364681:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364686:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364692:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364699:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364705:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364711:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364716:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364722:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364727:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364733:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364755:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364767:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364776:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364782:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364788:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364794:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364799:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364804:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364811:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364816:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364823:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364828:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364851:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364858:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364864:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364870:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364987:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.364997:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.365003:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.380778:0:5827:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9d070313ae00:5827] 1 exiting: rc = 0 00000100:00100000:0.0:1787787414.383061:0:5826:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9d070313ba00:5826] 0 exiting: rc = 1 00000100:00100000:3.0:1787787414.384170:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384180:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384191:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384196:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384202:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384275:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384280:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384285:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384290:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384295:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384300:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384305:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384310:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384316:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384322:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384327:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384332:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384337:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384343:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384347:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384352:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384357:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384362:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384367:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384372:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384377:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384382:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384387:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384391:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384396:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384401:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384406:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384411:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384415:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384420:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384455:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384460:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384465:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384470:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384532:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384538:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384544:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384551:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384558:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384564:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384569:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384574:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384579:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384583:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384588:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384593:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384597:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384602:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384607:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384613:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384619:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384623:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384628:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384633:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384638:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384643:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384648:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384654:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.384659:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.385965:0:5829:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9d070313b400:5829] 1 exiting: rc = 0 00000100:00100000:1.0:1787787414.387818:0:5828:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9d070313a200:5828] 0 exiting: rc = 1 00000100:00100000:3.0:1787787414.387920:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.387928:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.387933:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.387938:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.387942:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.387947:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.387963:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.387967:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.387973:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.387981:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.387988:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.387996:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388002:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388010:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388017:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388025:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388031:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388038:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388044:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388050:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388056:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388063:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388075:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388079:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388084:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388089:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388094:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388099:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388103:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388109:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388115:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388120:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388126:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388135:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388146:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388152:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388156:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388161:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388166:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388171:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388175:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388186:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388191:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388197:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388204:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388225:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388230:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388243:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388248:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388252:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388257:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388261:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388265:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388269:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388274:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388278:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388282:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388286:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388291:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388295:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388299:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388303:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388307:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.388311:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.388666:0:5830:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9d070313aa00:5830] 0 exiting: rc = 1 00000100:00100000:2.0:1787787414.388870:0:5831:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9d070313bc00:5831] 1 exiting: rc = 0 00000100:00100000:3.0:1787787414.389085:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389091:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389097:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389101:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389107:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389112:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389116:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389120:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389124:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389130:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389135:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389140:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389154:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389159:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389164:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389169:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389174:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389178:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389184:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389189:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389194:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389199:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389215:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389223:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389228:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389241:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389246:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389250:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389255:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389260:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389265:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389275:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389280:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389285:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389291:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389295:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389300:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389305:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389310:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389315:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389319:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389323:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389327:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389332:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389336:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389341:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389346:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389357:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389363:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389368:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389373:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389378:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389384:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389390:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389398:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389407:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389412:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389417:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389421:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389426:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389430:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389434:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389455:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787414.389460:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.390375:0:5832:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9d070313be00:5832] 0 exiting: rc = 1 00000100:00100000:1.0:1787787414.394286:0:5833:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9d070313a000:5833] 1 exiting: rc = 0 00000100:00100000:1.0:1787787414.394861:0:5834:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9d070313ac00:5834] 2 exiting: rc = 0 00000100:00100000:0.0:1787787414.396613:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396624:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396631:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396636:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396641:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396646:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396651:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396659:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396665:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396672:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396678:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396700:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396705:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396717:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396724:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396729:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396734:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396739:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396748:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396753:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396759:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396764:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396770:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396775:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396781:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396805:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396812:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396819:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396830:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396839:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396845:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396850:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396855:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396861:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396871:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396936:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396949:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396955:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396960:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396968:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396973:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396979:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396988:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396993:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.396999:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.397004:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.397017:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.397022:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.397028:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.397050:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.397061:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.397067:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.397072:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.397078:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.397083:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.397091:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.397097:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.397102:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.397110:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.397116:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.397121:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.397127:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.397132:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787414.397148:0:13061:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787787414.402661:0:13061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787787414.402672:0:13061:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787787414.402677:0:13061:0:(genops.c:885:class_export_put()) final put ffff9d070390d800/MDS_uuid 00000020:00000080:0.0:1787787414.402681:0:13061:0:(genops.c:844:class_export_destroy()) destroying export ffff9d070390d800/MDS_uuid for MDS 00000020:01000000:0.0:1787787414.402686:0:13061:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787787414.402801:0:13061:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1787787415.166522:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787787415.932994:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787787415.933004:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787787415.933010:0:38:0:(import.c:65:import_set_state_nolock()) ffff9d073763d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787787415.933023:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 323 00000100:00080000:3.0:1787787415.933032:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787787415.933041:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d073763d000 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:3.0:1787787415.933754:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0705974000 x1874630694488064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787787415.933789:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787787415.933795:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787787415.933797:0:38:0:(import.c:65:import_set_state_nolock()) ffff9d073472e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787787415.933805:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 323 00000100:00080000:3.0:1787787415.933810:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787787415.933837:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d073472e000 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:3.0:1787787415.933858:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0705976580 x1874630694488192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787787415.933900:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787787415.933925:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07059770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694487936:0@lo:400:kworker.0 00000400:00000100:3.0:1787787415.934000:0:3292:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874630694487936 offset 0 length 224: 4 00000100:00100000:3.0:1787787415.934954:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0705974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3290:1874630694488064:0@lo:38:kworker.0 00000400:00000100:3.0:1787787415.934997:0:3290:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874630694488064 offset 0 length 520: 4 00000100:00100000:3.0:1787787415.935023:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0705976580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3290:1874630694488192:0@lo:38:kworker.0 00000400:00000100:3.0:1787787415.935040:0:3290:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874630694488192 offset 0 length 520: 4 00010000:00010000:3.0:1787787416.194082:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787787417.056023:0:13216:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787787417.077417:0:13216:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787787417.077499:0:13216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0701647c00/0xdeb1953cba4b10a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b10a7 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787417.077514:0:13216:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0701647c00/0xdeb1953cba4b10a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b10a7 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787417.077522:0:13216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0701647c00/0xdeb1953cba4b10a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xdeb1953cba4b10a7 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787417.077530:0:13216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff9d0701647c00/0xdeb1953cba4b10a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xdeb1953cba4b10a7 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787417.077552:0:13216:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787787417.077557:0:13216:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787787417.077587:0:13216:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787787417.077598:0:13216:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d0705974000 x1874630694488064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787787430 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787417.077616:0:13216:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787787417.077622:0:13216:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787787417.077628:0:13216:0:(import.c:65:import_set_state_nolock()) ffff9d073763d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787787417.077633:0:13216:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787787417.077636:0:13216:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d0705974000 x1874630694488064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787787430 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787417.077643:0:13216:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787787417.077646:0:13216:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00010000:00010000:1.0:1787787417.077759:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787417.077766:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d0701647c00/0xdeb1953cba4b10a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xdeb1953cba4b10a7 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787417.077774:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0701647c00 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:1.0:1787787417.077778:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d0701647c00/0xdeb1953cba4b10a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xdeb1953cba4b10a7 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787417.077786:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d0701647c00/0xdeb1953cba4b10a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xdeb1953cba4b10a7 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787417.077793:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d0701647c00/0xdeb1953cba4b10a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xdeb1953cba4b10a7 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787417.077800:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787787417.077802:0:5808:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787787417.077805:0:5808:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787787417.077843:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d0701647c00/0xdeb1953cba4b10a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xdeb1953cba4b10a7 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787417.077849:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787417.077882:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d0701647c00/0xdeb1953cba4b10a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xdeb1953cba4b10a7 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787417.077889:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d0701647c00/0xdeb1953cba4b10a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xdeb1953cba4b10a7 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787417.077901:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787417.077903:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787417.077905:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787417.078083:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694488320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787787417.078147:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787417.078261:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694488320 00000100:00100000:0.0:1787787417.078267:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694488320 00000100:00100000:0.0:1787787417.078318:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787787417.078325:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705815850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3292:x1874630694488320:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787787417.078332:0:5807:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787787417 with bad export cookie 16046771035353845129 00000100:00100000:2.0:1787787417.080882:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0705974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3290:1874630694488064:0@lo:38:kworker.0 00010000:00010000:3.0:1787787417.082147:0:13216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0701646800/0xdeb1953cba4b10ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b10b5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787417.082164:0:13216:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0701646800/0xdeb1953cba4b10ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b10b5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787417.082173:0:13216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0701646800/0xdeb1953cba4b10ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdeb1953cba4b10b5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787417.082180:0:13216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff9d0701646800/0xdeb1953cba4b10ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdeb1953cba4b10b5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787417.082202:0:13216:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787417.082208:0:13216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d072212bc00/0xdeb1953cba4b12d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b12de expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787417.082247:0:13216:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d072212bc00/0xdeb1953cba4b12d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b12de expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787417.082255:0:13216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d072212bc00/0xdeb1953cba4b12d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdeb1953cba4b12de expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787417.082261:0:13216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff9d072212bc00/0xdeb1953cba4b12d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdeb1953cba4b12de expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787417.082711:0:13216:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787787417.082718:0:13216:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787787417.082751:0:13216:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787787417.082756:0:13216:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1787787417.082761:0:13216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787787417.082766:0:13216:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787787417.082771:0:13216:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9d072dfbb370) has no exports 00000020:00080000:3.0:1787787417.082794:0:13216:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9d072dfbb370) has no exports 00000020:01000000:3.0:1787787417.091512:0:13216:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d073d9bb780 - data ffff9d0737cba0d8/ffff9d07378c1c00 00000020:01000000:3.0:1787787417.091679:0:13216:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d07059ccba0 - data ffff9d060141a1b0/ffff9d073ff7f000 00010000:00010000:1.0:1787787417.091919:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787787417.091929:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d0701646800/0xdeb1953cba4b10ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdeb1953cba4b10b5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787417.091940:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0701646800 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:1.0:1787787417.091944:0:8440:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d0701646800/0xdeb1953cba4b10ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdeb1953cba4b10b5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787417.091954:0:8440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d0701646800/0xdeb1953cba4b10ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xdeb1953cba4b10b5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787417.091962:0:8440:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d0701646800/0xdeb1953cba4b10ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xdeb1953cba4b10b5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787417.091967:0:8440:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787787417.091969:0:8440:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1787787417.091972:0:8440:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1787787417.092008:0:8440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d0701646800/0xdeb1953cba4b10ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdeb1953cba4b10b5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787417.092032:0:8440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787417.092062:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d0701646800/0xdeb1953cba4b10ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdeb1953cba4b10b5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787417.092070:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d0701646800/0xdeb1953cba4b10ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdeb1953cba4b10b5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787417.092083:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787417.092087:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d072212bc00/0xdeb1953cba4b12d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdeb1953cba4b12de expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787417.092093:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212bc00 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:1.0:1787787417.092097:0:8440:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d072212bc00/0xdeb1953cba4b12d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdeb1953cba4b12de expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787417.092104:0:8440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d072212bc00/0xdeb1953cba4b12d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdeb1953cba4b12de expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787417.092111:0:8440:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d072212bc00/0xdeb1953cba4b12d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdeb1953cba4b12de expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787417.092117:0:8440:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787787417.092119:0:8440:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787787417.092121:0:8440:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787787417.092134:0:8440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d072212bc00/0xdeb1953cba4b12d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdeb1953cba4b12de expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787417.092141:0:8440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787417.092146:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d072212bc00/0xdeb1953cba4b12d7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdeb1953cba4b12de expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787417.092163:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d072212bc00/0xdeb1953cba4b12d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdeb1953cba4b12de expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787417.092172:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787417.092174:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787417.092176:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787417.092194:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694488576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787787417.092267:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787417.092382:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787787417.092389:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694488448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787787417.092411:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787417.092457:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694488576 00000100:00100000:1.0:1787787417.092463:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694488576 00000100:00100000:1.0:1787787417.092492:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694488448 00000100:00100000:1.0:1787787417.092494:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694488448 00000100:00100000:1.0:1787787417.092507:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787787417.092514:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3294:x1874630694488576:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787787417.092520:0:5805:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787787417 with bad export cookie 16046771035353845129 00000100:00100000:1.0:1787787417.092559:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3294:x1874630694488576:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (292us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787787417.092566:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787787417.092580:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787787417.092584:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a0a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3294:x1874630694488448:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787787417.092589:0:5805:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787787417 with bad export cookie 16046771035353845129 00000100:00100000:1.0:1787787417.092611:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a0a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3294:x1874630694488448:12345-0@lo:103:ldlm_bl.0 Request processed in 24us (199us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787787417.092625:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1787787417.092660:0:3294:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.110@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787787417.092664:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9d0702c03800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787787417.092668:0:3294:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.110@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1787787417.093402:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787787417.104247:0:3294:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.110@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787787417.104252:0:3294:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787787417.104261:0:3294:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d07059770c0 x1874630694487936/t0(0) o400->MGC192.168.206.110@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787787431 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787417.104366:0:3294:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d0707a09a40 x1874630694488320/t0(0) o103->MGC192.168.206.110@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787787433 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787417.104375:0:3294:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d0707a09680 x1874630694488576/t0(0) o103->MGC192.168.206.110@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787787433 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787417.104384:0:3294:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d0707a0b480 x1874630694488448/t0(0) o103->MGC192.168.206.110@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787787433 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787787417.104391:0:3294:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787787417.104393:0:3294:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787787417.104395:0:3294:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787787417.104398:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9d0702c03800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787787417.104403:0:3294:0:(import.c:510:import_select_connection()) MGC192.168.206.110@tcp: connect to NID 0@lo last attempt 113 00000100:00080000:1.0:1787787417.104411:0:3294:0:(import.c:624:import_select_connection()) MGC192.168.206.110@tcp: import ffff9d0702c03800 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:1.0:1787787417.104474:0:3294:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0707a083c0 x1874630694488704/t0(0) o250->MGC192.168.206.110@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787787417.104765:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694488576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787787417.104790:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1500c007-b35b-4004-b231-bb5a7ec082ef:3294:1874630694488448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787417.104901:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694488320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787417.104910:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07059770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1500c007-b35b-4004-b231-bb5a7ec082ef:3292:1874630694487936:0@lo:400:kworker.0 00000100:00100000:2.0:1787787417.104933:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1500c007-b35b-4004-b231-bb5a7ec082ef:3290:1874630694488704:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:2.0:1787787417.104976:0:3290:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874630694488704 offset 0 length 520: 4 00000400:00000100:1.0:1787787417.110268:0:5807:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1874630694488320 offset 224 length 224: 4 00000100:00100000:1.0:1787787417.110369:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705815850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3292:x1874630694488320:12345-0@lo:103:ldlm_bl.0 Request processed in 32041us (32219us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787787417.110394:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00100000:10000000:3.0:1787787417.123322:0:13216:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787787417.150411:0:13216:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b0eaf 00000020:00000080:0.0:1787787417.150424:0:13216:0:(genops.c:885:class_export_put()) final put ffff9d073ff93000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1787787417.150475:0:13216:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d0707278800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787787417.150479:0:13216:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d0707278800 2 00000020:01000004:0.0:1787787417.150495:0:13216:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d0707278800 from lustre-OST0000 00000020:00000080:0.0:1787787417.150516:0:13216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787787417.150526:0:13216:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787787417.150530:0:13216:0:(genops.c:885:class_export_put()) final put ffff9d073ff95800/lustre-OST0000_UUID 00000020:00000080:0.0:1787787417.150533:0:13216:0:(genops.c:844:class_export_destroy()) destroying export ffff9d073ff95800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1787787417.150539:0:13216:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1787787417.150582:0:13216:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1787787417.150586:0:13216:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787787417.150590:0:13216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787787417.150594:0:13216:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787787417.150601:0:13216:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9d073763c000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787787417.150607:0:13216:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9d07031299b8) has exports, disconnecting them 00000020:00080000:0.0:1787787417.150612:0:13216:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9d073763c000), last request at 1787787217 00000020:00000080:0.0:1787787417.150616:0:13216:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b0ed9 00000020:00080000:0.0:1787787417.150625:0:13216:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d073763c000): rc 0 00000020:00000080:0.0:1787787417.150630:0:13216:0:(genops.c:885:class_export_put()) final put ffff9d073763c000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787787417.151360:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9d073ff93000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787787417.151370:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9d073763c000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1787787417.151883:0:13216:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787787417.151888:0:13216:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787787417.151892:0:13216:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787787417.151897:0:13216:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787787417.152031:0:13216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787787417.152037:0:13216:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1787787417.152042:0:13216:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d0707278800 1 00000020:00000080:1.0:1787787417.152047:0:13216:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b0e69 00000020:00000080:1.0:1787787417.152053:0:13216:0:(genops.c:885:class_export_put()) final put ffff9d0705983800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1787787417.152057:0:13216:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1787787417.152061:0:13216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787787417.152064:0:13216:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787787417.152067:0:13216:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9d073ca03370) has no exports 00000020:00000080:3.0:1787787417.152136:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d073763d000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787787417.152143:0:38:0:(genops.c:885:class_export_put()) final put ffff9d073762b000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1787787417.152145:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9d073762b000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1787787417.152149:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1787787417.152191:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0705983800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787787417.167002:0:13216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787787417.167017:0:13216:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1787787417.167022:0:13216:0:(genops.c:885:class_export_put()) final put ffff9d0707279000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1787787417.167027:0:13216:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0707279000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1787787417.167033:0:13216:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1787787417.167171:0:13216:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9d070727f800 00000020:02000400:1.0:1787787417.167262:0:13216:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1787787417.240834:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787418.302762:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787419.336698:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787787419.648173:0:13365:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787787419.658532:0:13365:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1787787419.658602:0:13365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0708770400/0xdeb1953cba4b1084 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b108b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787419.658616:0:13365:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0708770400/0xdeb1953cba4b1084 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b108b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787419.658623:0:13365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0708770400/0xdeb1953cba4b1084 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdeb1953cba4b108b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787419.658630:0:13365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff9d0708770400/0xdeb1953cba4b1084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdeb1953cba4b108b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787419.658657:0:13365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787787419.658663:0:13365:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787787419.658683:0:13365:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787787419.658694:0:13365:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d0705976580 x1874630694488192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787787430 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787419.658709:0:13365:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787787419.658714:0:13365:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787787419.658720:0:13365:0:(import.c:65:import_set_state_nolock()) ffff9d073472e000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787787419.658725:0:13365:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787787419.658729:0:13365:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d0705976580 x1874630694488192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787787430 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787419.658736:0:13365:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787787419.658740:0:13365:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00010000:00010000:1.0:1787787419.659477:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787419.659486:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d0708770400/0xdeb1953cba4b1084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdeb1953cba4b108b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787419.659496:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708770400 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:1.0:1787787419.659499:0:8439:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d0708770400/0xdeb1953cba4b1084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdeb1953cba4b108b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787419.659509:0:8439:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d0708770400/0xdeb1953cba4b1084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdeb1953cba4b108b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787419.659524:0:8439:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d0708770400/0xdeb1953cba4b1084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdeb1953cba4b108b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787419.659530:0:8439:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787787419.659533:0:8439:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787787419.659536:0:8439:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787787419.659548:0:8439:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d0702c03800 00010000:00010000:1.0:1787787419.659552:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d0708770400/0xdeb1953cba4b1084 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdeb1953cba4b108b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787419.659559:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d0708770400/0xdeb1953cba4b1084 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdeb1953cba4b108b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787419.659569:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787419.659571:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787419.659573:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787419.659614:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0705976580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3290:1874630694488192:0@lo:38:kworker.0 00010000:00010000:0.0:1787787419.661716:0:13365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d072212b200/0xdeb1953cba4b1092 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b1099 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787419.661733:0:13365:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d072212b200/0xdeb1953cba4b1092 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b1099 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787419.661803:0:13365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d072212b200/0xdeb1953cba4b1092 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdeb1953cba4b1099 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787419.661812:0:13365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff9d072212b200/0xdeb1953cba4b1092 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdeb1953cba4b1099 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787419.661829:0:13365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787787419.661846:0:13365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d072212a800/0xdeb1953cba4b12c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b12d0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787419.661852:0:13365:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d072212a800/0xdeb1953cba4b12c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b12d0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787419.661926:0:13365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d072212a800/0xdeb1953cba4b12c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdeb1953cba4b12d0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787419.661933:0:13365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff9d072212a800/0xdeb1953cba4b12c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdeb1953cba4b12d0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787419.661986:0:13365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787787419.661991:0:13365:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1787787419.662014:0:13365:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1787787419.662017:0:13365:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1787787419.662021:0:13365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787787419.662025:0:13365:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787787419.662029:0:13365:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9d07092d8000) has no exports 00000020:00080000:0.0:1787787419.662057:0:13365:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9d07092d8000) has no exports 00010000:00010000:3.0:1787787419.665237:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787787419.665250:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d072212b200/0xdeb1953cba4b1092 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdeb1953cba4b1099 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787419.665262:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212b200 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:3.0:1787787419.665267:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d072212b200/0xdeb1953cba4b1092 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdeb1953cba4b1099 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787419.665277:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d072212b200/0xdeb1953cba4b1092 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdeb1953cba4b1099 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787787419.665285:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d072212b200/0xdeb1953cba4b1092 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdeb1953cba4b1099 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787419.665291:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787787419.665294:0:5809:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1787787419.665297:0:5809:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1787787419.665313:0:5809:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d0702c03800 00010000:00010000:3.0:1787787419.665317:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d072212b200/0xdeb1953cba4b1092 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xdeb1953cba4b1099 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787419.665323:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d072212b200/0xdeb1953cba4b1092 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xdeb1953cba4b1099 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787419.665890:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787419.665984:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d072212a800/0xdeb1953cba4b12c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdeb1953cba4b12d0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787419.665993:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212a800 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:2.0:1787787419.665997:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d072212a800/0xdeb1953cba4b12c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdeb1953cba4b12d0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787419.666006:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d072212a800/0xdeb1953cba4b12c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xdeb1953cba4b12d0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787419.666013:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d072212a800/0xdeb1953cba4b12c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xdeb1953cba4b12d0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787419.666019:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787787419.666022:0:5808:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787787419.666039:0:5808:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787787419.666049:0:5808:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d0702c03800 00010000:00010000:2.0:1787787419.666052:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d072212a800/0xdeb1953cba4b12c9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xdeb1953cba4b12d0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787419.666069:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d072212a800/0xdeb1953cba4b12c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xdeb1953cba4b12d0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787419.666084:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787419.666086:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787419.666088:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787419.666669:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787419.666673:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787419.666674:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787787419.666718:0:13365:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d073d9bb2a0 - data ffff9d0737c485e8/ffff9d0737a26000 00000020:01000000:1.0:1787787419.668086:0:13365:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d0706b23120 - data ffff9d0601557e58/ffff9d0734756000 00100000:10000000:0.0:1787787419.695493:0:13365:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787787419.730941:0:13365:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b0f88 00000020:00000080:2.0:1787787419.730950:0:13365:0:(genops.c:885:class_export_put()) final put ffff9d0708b68800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1787787419.730967:0:13365:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d070598a000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1787787419.730971:0:13365:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d070598a000 2 00000020:01000004:2.0:1787787419.730974:0:13365:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d070598a000 from lustre-OST0001 00000020:00000080:2.0:1787787419.730996:0:13365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787787419.731004:0:13365:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1787787419.731007:0:13365:0:(genops.c:885:class_export_put()) final put ffff9d0708b6d000/lustre-OST0001_UUID 00000020:00000080:2.0:1787787419.731010:0:13365:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0708b6d000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1787787419.731015:0:13365:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1787787419.731120:0:13365:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 1500c007-b35b-4004-b231-bb5a7ec082ef->MGS 00010000:00010000:2.0:1787787419.731134:0:13365:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d072212ae00/0xdeb1953cba4b0e8c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdeb1953cba4b0e93 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787419.731147:0:13365:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d072212ae00/0xdeb1953cba4b0e8c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdeb1953cba4b0e93 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787419.731153:0:13365:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1787787419.731155:0:13365:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1787787419.731158:0:13365:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1787787419.731171:0:13365:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d0702c03800 00010000:00010000:2.0:1787787419.731267:0:13365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d072212ae00/0xdeb1953cba4b0e8c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdeb1953cba4b0e93 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787419.731284:0:13365:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d0701646000/0xdeb1953cba4b10d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdeb1953cba4b10df expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787419.731291:0:13365:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d0701646000/0xdeb1953cba4b10d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdeb1953cba4b10df expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787419.731296:0:13365:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787787419.731299:0:13365:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1787787419.731300:0:13365:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1787787419.731310:0:13365:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d0702c03800 00010000:00010000:2.0:1787787419.731313:0:13365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d0701646000/0xdeb1953cba4b10d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdeb1953cba4b10df expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787787419.731327:0:13365:0:(import.c:65:import_set_state_nolock()) ffff9d0702c03800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1787787419.731331:0:13365:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787787419.731332:0:13365:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787787419.731334:0:13365:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787787419.731337:0:13365:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787787419.731347:0:13365:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d0707a083c0 x1874630694488704/t0(0) o250->MGC192.168.206.110@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787787427 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787787419.731366:0:13365:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787787419.731369:0:13365:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000100:00100000:0.0:1787787419.731431:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1500c007-b35b-4004-b231-bb5a7ec082ef:3290:1874630694488704:0@lo:250:ptlrpcd_00_03.0 10000000:01000000:2.0:1787787419.731526:0:13365:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787787419.731533:0:13365:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b0d7b 00000020:00000080:2.0:1787787419.731537:0:13365:0:(genops.c:885:class_export_put()) final put ffff9d0707de4800/1500c007-b35b-4004-b231-bb5a7ec082ef 00000020:01000000:2.0:1787787419.731543:0:13365:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.110@tcp (flags='') 00000020:00000080:2.0:1787787419.731547:0:13365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787787419.731551:0:13365:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.110@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787787419.731555:0:13365:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9d0703128000) has no exports 00000020:00000080:3.0:1787787419.731646:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0708b68800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1787787419.731657:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0707de4800/1500c007-b35b-4004-b231-bb5a7ec082ef for MGC192.168.206.110@tcp 10000000:01000000:0.0:1787787419.731949:0:5817:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1787787419.732127:0:13365:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.110@tcp: client import never connected 00000100:00080000:2.0:1787787419.732130:0:13365:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1787787419.732132:0:13365:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787787419.732135:0:13365:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1787787419.732136:0:13365:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787787419.732183:0:13365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787787419.732188:0:13365:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.110@tcp (uuid 1500c007-b35b-4004-b231-bb5a7ec082ef) 00000020:01000000:2.0:1787787419.732193:0:13365:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787787419.732196:0:13365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787787419.732200:0:13365:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787787419.732218:0:13365:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9d07185ab000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787787419.732223:0:13365:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9d073ca04d28) has exports, disconnecting them 00000020:00080000:2.0:1787787419.732227:0:13365:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9d07185ab000), last request at 1787787235 00000020:00000080:2.0:1787787419.732230:0:13365:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b0fb2 00000020:00080000:2.0:1787787419.732239:0:13365:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d07185ab000): rc 0 00000020:00000080:2.0:1787787419.732242:0:13365:0:(genops.c:885:class_export_put()) final put ffff9d07185ab000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787787419.732876:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d0702c03800 for MGC192.168.206.110@tcp 00000020:00000080:3.0:1787787419.732884:0:8:0:(genops.c:885:class_export_put()) final put ffff9d0702c07000/1500c007-b35b-4004-b231-bb5a7ec082ef 00000020:00000080:3.0:1787787419.732887:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0702c07000/1500c007-b35b-4004-b231-bb5a7ec082ef for MGC192.168.206.110@tcp 00000020:01000000:3.0:1787787419.732892:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.110@tcp (1500c007-b35b-4004-b231-bb5a7ec082ef) 00000020:00000080:3.0:1787787419.733104:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d07185ab000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1787787419.733499:0:13365:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1787787419.733503:0:13365:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787787419.733507:0:13365:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787787419.733512:0:13365:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787787419.733565:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:0.0:1787787419.733673:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d073472e000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1787787419.734475:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1787787419.734617:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:0.0:1787787419.734740:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:0.0:1787787419.734934:0:5804:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9d0707c5b200:5804] 1 exiting: rc = 0 00000100:00100000:3.0:1787787419.736540:0:5803:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9d07033f5a00:5803] 0 exiting: rc = 1 00000100:00100000:0.0:1787787419.736649:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.736959:0:5805:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9d07033f5c00:5805] 0 exiting: rc = 1 00000100:00100000:0.0:1787787419.738579:0:5806:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9d0706a33a00:5806] 1 exiting: rc = 0 00000100:00100000:0.0:1787787419.738672:0:8496:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9d072dc73400:8496] 3 exiting: rc = 0 00000100:00100000:0.0:1787787419.740549:0:5807:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9d0706a32e00:5807] 2 exiting: rc = 0 00000100:00100000:3.0:1787787419.740671:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740680:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740686:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740692:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740696:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740701:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740706:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740711:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740716:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740721:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740726:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740731:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740737:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740743:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740747:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740754:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740760:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740767:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740771:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740777:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740782:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740786:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740790:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740795:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740800:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740818:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740823:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740827:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740832:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740837:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740843:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740859:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740865:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740870:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740874:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740879:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740885:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740889:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740894:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740898:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740904:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740908:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740913:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740917:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740921:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740926:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740931:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740935:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740940:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740945:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740951:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740955:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740960:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740965:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740969:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740974:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740979:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740985:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740989:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.740993:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.741004:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.741009:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.741014:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.741018:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787787419.741949:0:13365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787787419.741957:0:13365:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1787787419.741961:0:13365:0:(genops.c:885:class_export_put()) final put ffff9d07185ad800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1787787419.741965:0:13365:0:(genops.c:844:class_export_destroy()) destroying export ffff9d07185ad800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1787787419.741971:0:13365:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1787787419.742006:0:13365:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d070598a000 1 00000020:00000080:3.0:1787787419.742011:0:13365:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdeb1953cba4b0f57 00000020:00000080:3.0:1787787419.742016:0:13365:0:(genops.c:885:class_export_put()) final put ffff9d073c4a2000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1787787419.742032:0:13365:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1787787419.742036:0:13365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787787419.742039:0:13365:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787787419.742043:0:13365:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9d073ca019b8) has no exports 00000020:00000080:0.0:1787787419.742256:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9d073c4a2000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1787787419.753216:0:13365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787787419.753229:0:13365:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1787787419.753234:0:13365:0:(genops.c:885:class_export_put()) final put ffff9d070598e800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1787787419.753239:0:13365:0:(genops.c:844:class_export_destroy()) destroying export ffff9d070598e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1787787419.753246:0:13365:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1787787419.753429:0:13365:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9d0705989000 00000020:01000000:0.0:1787787419.753501:0:13365:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1787787419.753505:0:13365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787787419.753509:0:13365:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787787419.753513:0:13365:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9d070312b370) has no exports 00000020:00000080:0.0:1787787419.753538:0:13365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787787419.753544:0:13365:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1787787419.753547:0:13365:0:(genops.c:885:class_export_put()) final put ffff9d0705984000/OSS_uuid 00000020:00000080:0.0:1787787419.753549:0:13365:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0705984000/OSS_uuid for OSS 00000020:01000000:0.0:1787787419.753553:0:13365:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1787787419.753619:0:6673:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9d0707cf3800:6673] 0 exiting: rc = 1 00000100:00100000:1.0:1787787419.754686:0:10776:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9d0737e4de00:10776] 3 exiting: rc = 0 00000100:00080000:3.0:1787787419.759297:0:5815:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1787787419.759552:0:6674:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9d0707cf2400:6674] 1 exiting: rc = 0 00000100:00100000:3.0:1787787419.759601:0:6675:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9d070877a800:6675] 2 exiting: rc = 0 00000100:00100000:0.0:1787787419.759960:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.759969:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.759975:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.759981:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.759986:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.759991:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.759997:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760001:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760006:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760012:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760018:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760023:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760028:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760034:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760049:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760054:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760059:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760064:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760069:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760075:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760080:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760086:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760091:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760095:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760101:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760105:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760111:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760116:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760120:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760125:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760130:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760134:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760138:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760143:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760148:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760153:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760158:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760163:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760168:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760255:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760263:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760268:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760273:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760277:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760282:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760287:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760291:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760295:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760300:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760312:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760317:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760322:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760326:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760330:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760337:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760342:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760347:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760351:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760356:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760360:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760365:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760369:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760374:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.760380:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.761478:0:12107:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9d07052c2c00:12107] 2 exiting: rc = 0 00000100:00100000:3.0:1787787419.761547:0:6677:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9d070877b400:6677] 1 exiting: rc = 0 00000100:00100000:2.0:1787787419.761680:0:6676:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9d070877ba00:6676] 0 exiting: rc = 1 00000100:00100000:0.0:1787787419.761813:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.761822:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.761826:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.761831:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.761835:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.761840:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.761844:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.761910:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.761916:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.761921:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.761925:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.761930:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.761935:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.761940:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.761945:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.761949:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.761954:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.761959:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.761964:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.761969:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.761982:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.761988:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.761993:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.761997:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762002:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762007:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762011:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762017:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762022:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762027:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762032:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762036:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762041:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762046:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762050:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762055:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762059:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762064:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762068:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762073:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762078:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762082:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762087:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762092:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762096:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762101:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762105:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762109:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762113:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762117:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762121:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762125:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762130:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762134:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762138:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762148:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762153:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762157:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762163:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762168:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762242:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762250:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762255:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.762260:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.763260:0:6679:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9d072dee2200:6679] 1 exiting: rc = 0 00000100:00100000:3.0:1787787419.763403:0:6680:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9d072dee3400:6680] 2 exiting: rc = 0 00000100:00100000:0.0:1787787419.763747:0:6678:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9d072dee2400:6678] 0 exiting: rc = 1 00000100:00100000:0.0:1787787419.763802:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.763808:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.763814:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.763819:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.763824:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.763829:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.763835:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.763839:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.763844:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.763964:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.763970:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.763975:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.763980:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.763986:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.763992:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764001:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764006:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764011:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764017:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764022:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764028:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764033:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764048:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764053:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764058:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764071:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764075:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764080:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764084:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764089:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764094:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764098:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764103:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764108:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764113:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764117:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764122:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764127:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764131:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764136:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764141:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764146:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764151:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764157:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764161:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764167:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764258:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764265:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764270:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764275:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764279:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764285:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764290:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764296:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764301:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764306:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764310:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764315:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764320:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764324:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764337:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764342:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764349:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.764355:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787419.768993:0:6681:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9d0707217a00:6681] 0 exiting: rc = 1 00000100:00100000:1.0:1787787419.769130:0:6682:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9d0707216e00:6682] 1 exiting: rc = 0 00000100:00100000:0.0:1787787419.769275:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769283:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769288:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769293:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769299:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769303:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769308:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769313:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769318:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769323:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769328:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769332:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769337:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769343:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769349:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769355:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769360:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769365:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769371:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769377:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769384:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769389:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769394:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769399:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769405:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769410:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769415:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769420:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769425:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769430:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769468:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769486:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769491:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769496:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769501:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769506:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769511:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769516:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769521:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769525:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769531:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769536:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769541:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769546:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769551:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769557:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769565:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769572:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769577:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769584:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769612:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769619:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769624:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769630:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769635:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769640:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769645:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769651:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769656:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769660:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769665:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769670:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769675:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.769680:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.770609:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9d072dee0000:6683] 0 exiting: rc = 1 00000100:00100000:2.0:1787787419.770817:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9d072dee0c00:6684] 1 exiting: rc = 0 00000100:00100000:0.0:1787787419.771031:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771046:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771051:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771058:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771063:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771068:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771074:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771079:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771085:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771091:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771097:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771103:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771120:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771126:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771131:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771136:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771144:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771150:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771156:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771162:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771166:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771183:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771189:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771196:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771229:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771238:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771243:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771249:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771255:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771261:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771266:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771272:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771278:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771284:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771290:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771295:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771322:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771328:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771333:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771339:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771344:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771350:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771356:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771361:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771367:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771373:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771379:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771384:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771403:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771409:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771415:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771420:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771426:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.771432:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.774727:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.774744:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.774751:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.774756:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.774762:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.774768:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.774794:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.774802:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.774808:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787419.774814:0:13365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1787787419.783737:0:13365:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1787787434.201244:0:13982:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787787440.667315:0:14443:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787787440.667320:0:14443:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787787440.667433:0:14443:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9d0706340800 00000020:01000004:2.0:1787787440.667467:0:14443:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787787440.667475:0:14443:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787787440.667487:0:14443:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9d070312b370) 00000020:00000080:2.0:1787787440.667498:0:14443:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787787440.682015:0:14443:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787787440.684828:0:14443:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1787787440.685187:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1787787440.685652:0:14443:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787787440.685730:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:2.0:1787787440.685834:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1787787440.685927:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1787787440.686062:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:2.0:1787787440.686168:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:2.0:1787787440.686678:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:2.0:1787787440.688561:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 189: rc = 0 00100000:10000000:2.0:1787787440.688658:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 189: rc = 0 00100000:10000000:2.0:1787787440.689025:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 643: rc = 0 00100000:10000000:2.0:1787787440.689777:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 643: rc = 0 00100000:10000000:2.0:1787787440.690035:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 643: rc = 0 00100000:10000000:2.0:1787787440.690368:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 643: rc = 0 00100000:10000000:2.0:1787787440.690730:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 643: rc = 0 00100000:10000000:2.0:1787787440.690956:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 643: rc = 0 00100000:10000000:2.0:1787787440.691236:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 643: rc = 0 00100000:10000000:2.0:1787787440.691740:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 643: rc = 0 00100000:10000000:2.0:1787787440.691998:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 643: rc = 0 00100000:10000000:2.0:1787787440.692696:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 643: rc = 0 00100000:10000000:2.0:1787787440.692956:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 643: rc = 0 00100000:10000000:2.0:1787787440.693235:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 643: rc = 0 00100000:10000000:2.0:1787787440.693911:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 602: rc = 0 00100000:10000000:2.0:1787787440.694165:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 602: rc = 0 00100000:10000000:2.0:1787787440.694662:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 602: rc = 0 00100000:10000000:2.0:1787787440.694948:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 602: rc = 0 00100000:10000000:2.0:1787787440.695225:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 602: rc = 0 00100000:10000000:2.0:1787787440.695765:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 602: rc = 0 00100000:10000000:2.0:1787787440.696005:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 602: rc = 0 00100000:10000000:2.0:1787787440.696252:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 602: rc = 0 00100000:10000000:2.0:1787787440.696875:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 602: rc = 0 00100000:10000000:2.0:1787787440.697152:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 602: rc = 0 00100000:10000000:3.0:1787787440.697811:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 602: rc = 0 00100000:10000000:3.0:1787787440.698250:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 602: rc = 0 00100000:10000000:3.0:1787787440.698699:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 602: rc = 0 00100000:10000000:3.0:1787787440.698952:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 602: rc = 0 00100000:10000000:3.0:1787787440.699219:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 602: rc = 0 00100000:10000000:3.0:1787787440.699722:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 602: rc = 0 00100000:10000000:3.0:1787787440.699991:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 602: rc = 0 00100000:10000000:3.0:1787787440.700368:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 602: rc = 0 00100000:10000000:3.0:1787787440.701009:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 602: rc = 0 00100000:10000000:3.0:1787787440.701351:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 602: rc = 0 00100000:10000000:3.0:1787787440.701753:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 602: rc = 0 00100000:10000000:3.0:1787787440.702014:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 602: rc = 0 00100000:10000000:3.0:1787787440.702353:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 602: rc = 0 00100000:10000000:3.0:1787787440.702847:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 602: rc = 0 00100000:10000000:3.0:1787787440.703107:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 602: rc = 0 00100000:10000000:3.0:1787787440.703401:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 602: rc = 0 00100000:10000000:3.0:1787787440.703701:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 602: rc = 0 00100000:10000000:3.0:1787787440.703960:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 602: rc = 0 00100000:10000000:3.0:1787787440.704221:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 602: rc = 0 00100000:10000000:3.0:1787787440.704534:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 602: rc = 0 00100000:10000000:3.0:1787787440.705125:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 602: rc = 0 00100000:10000000:3.0:1787787440.705536:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 602: rc = 0 00100000:10000000:3.0:1787787440.705936:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 594: rc = 0 00100000:10000000:3.0:1787787440.706842:0:14443:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1787787440.707010:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 190: rc = 0 00100000:10000000:3.0:1787787440.707203:0:14443:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1787787440.707352:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 190: rc = 0 00100000:10000000:3.0:1787787440.707636:0:14443:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1787787440.707711:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 190: rc = 0 00100000:10000000:3.0:1787787440.708064:0:14443:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1787787440.708149:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 641: rc = 0 00100000:10000000:3.0:1787787440.708599:0:14443:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1787787440.708682:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 641: rc = 0 00100000:10000000:3.0:1787787440.708866:0:14443:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1787787440.708939:0:14443:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 641: rc = 0 00000020:00000080:3.0:1787787440.709201:0:14443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787787440.709209:0:14443:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787787440.709220:0:14443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdeb1953cba4b207c 00000020:01000004:3.0:1787787440.709228:0:14443:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787787440.709234:0:14443:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787787440.709239:0:14443:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d0706340800 from MGS 00000020:01000004:3.0:1787787440.709243:0:14443:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787787440.709252:0:14443:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9d073ca04d28) 00000020:00000080:3.0:1787787440.709341:0:14443:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787787440.709398:0:14443:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d0706340800 from MGS, refs=2 00080000:01000000:3.0:1787787440.709403:0:14443:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787787440.709561:0:14443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdeb1953cba4b208a 00000100:00100000:3.0:1787787440.709659:0:14443:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787787440.709787:0:14443:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787787440.709793:0:14443:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787787440.710226:0:14443:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787787440.710233:0:14443:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787787440.711021:0:14443:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787787440.711185:0:14443:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787787440.711192:0:14443:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787787440.711849:0:14443:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787787440.711856:0:14443:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787787440.712171:0:14443:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787787440.712177:0:14443:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787787440.712972:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787440.712976:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787440.712977:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787440.713380:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787440.713388:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787440.713390:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787440.714060:0:14443:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787787440.721389:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787787440.729139:0:14443:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787787440.729156:0:14443:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787787440.729159:0:14443:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787787440.731142:0:14452:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787787440.731291:0:14443:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787787440.731385:0:14443:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787787440.732111:0:14443:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787787440.733255:0:14443:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787787440.733836:0:14443:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787787440.733843:0:14443:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787787440.735614:0:14443:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787787440.735634:0:14443:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787787440.735959:0:14443:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787787440.735965:0:14443:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1787787440.736714:0:14456:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1787787440.736776:0:14443:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787787440.736795:0:14443:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.110@tcp' 00000020:01000004:1.0:1787787440.736797:0:14443:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787787440.736824:0:14443:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.110@tcp (typ=mgc) 00000020:00000080:1.0:1787787440.736835:0:14443:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.110@tcp (ffff9d07092d8000) 00000020:00000080:1.0:1787787440.736850:0:14443:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787787440.736917:0:14443:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d073763d800@MGC192.168.206.110@tcp: add connection 192.168.206.110@tcp at head 00010000:00010000:1.0:1787787440.737046:0:14443:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.110@tcp-0 is initialized 00000040:01000000:1.0:1787787440.737052:0:14443:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.110@tcp ctxt 1 is initialized 10000000:01000000:0.0:1787787440.740053:0:14458:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787787440.740131:0:14443:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.110@tcp (uuid 5502b2f0-3011-4fec-94b3-f0db12dfb3bb) 00000020:00000080:0.0:1787787440.740153:0:14443:0:(genops.c:1385:class_connect()) connect: client 5502b2f0-3011-4fec-94b3-f0db12dfb3bb, cookie 0xdeb1953cba4b2098 00000100:00080000:0.0:1787787440.740165:0:14443:0:(import.c:510:import_select_connection()) MGC192.168.206.110@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787787440.740172:0:14443:0:(import.c:624:import_select_connection()) MGC192.168.206.110@tcp: import ffff9d073763d800 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:0.0:1787787440.740215:0:14443:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0737e48000 x1874630694488832/t0(0) o250->MGC192.168.206.110@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787787440.740246:0:14443:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 5502b2f0-3011-4fec-94b3-f0db12dfb3bb->MGS 00000020:01000004:0.0:1787787440.740271:0:14443:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000100:00100000:1.0:1787787440.740277:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:3290:1874630694488832:0@lo:250:mount.lustre.0 00000020:01000004:0.0:1787787440.740277:0:14443:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787787440.740293:0:14443:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9d072dfbb370) 00000020:00000080:0.0:1787787440.740307:0:14443:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787787440.740347:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787440.740425:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694488832 00000100:00100000:1.0:1787787440.740432:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694488832 00000100:00100000:1.0:1787787440.740487:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787787440.740493:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072de4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3290:x1874630694488832:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1787787440.740516:0:14453:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 5502b2f0-3011-4fec-94b3-f0db12dfb3bb@0@lo t0 exp 0000000000000000 cur 352 last 0 00000020:00000080:1.0:1787787440.740537:0:14453:0:(genops.c:1385:class_connect()) connect: client 5502b2f0-3011-4fec-94b3-f0db12dfb3bb, cookie 0xdeb1953cba4b20a6 00000100:00080000:1.0:1787787440.740709:0:14453:0:(import.c:65:import_set_state_nolock()) ffff9d073763a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787787440.740764:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072de4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+5:3290:x1874630694488832:12345-0@lo:250:mount.lustre.0 Request processed in 269us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787440.740772:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787787440.740980:0:3290:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.110@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787787440.740989:0:3290:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.110@tcp: connect to target with instance 0 00000100:00080000:1.0:1787787440.741002:0:3290:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.110@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787787440.741006:0:3290:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787787440.741009:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9d073763d800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787787440.741011:0:3290:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787787440.741021:0:3290:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787787440.741026:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:3290:1874630694488832:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787787440.753270:0:14443:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787787440.753481:0:14443:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787787440.753487:0:14443:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787787440.756243:0:14443:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787787440.756255:0:14443:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787787440.757425:0:14443:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787787440.757470:0:14443:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787787440.759380:0:14443:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787787440.759798:0:14443:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787787440.759968:0:14443:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787787440.761112:0:14443:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787787440.761122:0:14443:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787787440.794234:0:14443:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787787440.794424:0:14443:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787787440.794433:0:14443:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787787440.796537:0:14443:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787787440.796550:0:14443:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787787440.797238:0:14443:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787787440.797399:0:14443:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787787440.797404:0:14443:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787787440.798634:0:14443:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787787440.798643:0:14443:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787787440.799182:0:14443:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787787440.799327:0:14443:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787787440.799332:0:14443:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787787440.800043:0:14443:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787787440.800050:0:14443:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787787440.802255:0:14443:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787787440.802424:0:14443:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787787440.802431:0:14443:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787787440.803049:0:14443:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787787440.803056:0:14443:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787787440.826320:0:14443:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787787440.826680:0:14443:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787787440.826686:0:14443:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787787440.828801:0:14443:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787787440.828820:0:14443:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787787440.829821:0:14443:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787787440.829830:0:14443:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787787440.830773:0:14443:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787787440.830794:0:14443:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1787787440.830800:0:14443:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.110@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787787440.830922:0:14443:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.110@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787787440.830953:0:14443:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.110@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1787787440.830957:0:14443:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787787440.830959:0:14443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787787440.830961:0:14443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787440.830962:0:14443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787787440.830963:0:14443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787440.830964:0:14443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787440.830965:0:14443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787787440.830967:0:14443:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787787440.830969:0:14443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787440.830970:0:14443:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787787440.830972:0:14443:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1787787440.831962:0:14443:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787787440.831967:0:14443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787787440.831968:0:14443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787440.831970:0:14443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787787440.831971:0:14443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787440.831973:0:14443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787440.832068:0:14443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787787440.832071:0:14443:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787787440.832072:0:14443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787440.832073:0:14443:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787787440.832113:0:14443:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787787440.832135:0:14443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e4b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14443:1874630694488960:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787787440.832203:0:14443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787440.832262:0:14443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07058a3180 going to sleep for 11 seconds 00000100:00100000:1.0:1787787440.832270:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694488960 00000100:00100000:1.0:1787787440.832279:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694488960 00000100:00100000:1.0:1787787440.832325:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787787440.832335:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072de4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+5:14443:x1874630694488960:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787787440.832381:0:14455:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787787440.832384:0:14455:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787787440.832387:0:14455:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1787787440.836975:0:14476:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787787440.837712:0:14455:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1787787440.840170:0:14477:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1787787440.840178:0:14477:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1787787440.840181:0:14477:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1787787440.840218:0:14477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1787787440.843564:0:14455:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787787440.843577:0:14455:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787787440.855120:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072de4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+5:14443:x1874630694488960:12345-0@lo:253:mount.lustre.0 Request processed in 22778us (22908us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787440.855140:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787787440.855150:0:14443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e4b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14443:1874630694488960:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787787440.855169:0:14443:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787787440.855184:0:14443:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787787440.855186:0:14443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787787440.855188:0:14443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787440.855189:0:14443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787787440.855191:0:14443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787440.855192:0:14443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787440.855194:0:14443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787787440.855196:0:14443:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787787440.855198:0:14443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787440.855199:0:14443:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787787440.855214:0:14443:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d0706340800 from lustre-MDT0000 10000000:01000000:0.0:1787787440.855236:0:14443:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787787440.855239:0:14443:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787787440.855242:0:14443:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9d07092d8000 10000000:01000000:0.0:1787787440.855247:0:14443:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787787440.855254:0:14443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9d07092d8000 from 1 10000000:01000000:0.0:1787787440.855257:0:14443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787787440.855294:0:14443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d07059fd600/0xdeb1953cba4b20ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787440.855305:0:14443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d07059fd600/0xdeb1953cba4b20ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787440.855314:0:14443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d07059fd600/0xdeb1953cba4b20ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787440.855341:0:14443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e4b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14443:1874630694489088:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787787440.855377:0:14443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787440.855421:0:14443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07058a33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787440.855423:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694489088 00000100:00100000:2.0:1787787440.855430:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694489088 00000100:00100000:2.0:1787787440.855492:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787787440.855500:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072de4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+5:14443:x1874630694489088:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787787440.855512:0:14454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787440.855525:0:14454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d073fd38000/0xdeb1953cba4b20b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b20ad expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787440.855557:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d073fd38000/0xdeb1953cba4b20b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b20ad expref: 6 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787440.855578:0:14454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d073fd38000/0xdeb1953cba4b20b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b20ad expref: 6 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787440.855587:0:14454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd38000, rc 0) 00000100:00100000:2.0:1787787440.855785:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072de4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+6:14443:x1874630694489088:12345-0@lo:101:mount.lustre.0 Request processed in 284us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787440.855792:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787787440.855868:0:14443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e4b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14443:1874630694489088:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787787440.855881:0:14443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d07059fd600/0xdeb1953cba4b20ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b20b4 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787440.855900:0:14443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d07059fd600/0xdeb1953cba4b20ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b20b4 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787440.855944:0:14443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e4b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14443:1874630694489216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787787440.855977:0:14443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787440.856007:0:14443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07058a33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787440.856048:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694489216 00000100:00100000:2.0:1787787440.856052:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694489216 00000100:00100000:2.0:1787787440.856079:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787787440.856094:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072de4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+6:14443:x1874630694489216:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787787440.856308:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072de4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+6:14443:x1874630694489216:12345-0@lo:501:mount.lustre.0 Request processed in 221us (329us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787787440.856315:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787787440.856417:0:14443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e4b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14443:1874630694489216:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787787440.856479:0:14443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787787440.856488:0:14443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d07059fd600/0xdeb1953cba4b20ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b20b4 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787440.856497:0:14443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d07059fd600/0xdeb1953cba4b20ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b20b4 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787440.856505:0:14443:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d0706340800 10000000:01000000:0.0:1787787440.856509:0:14443:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787787440.856513:0:14443:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9d0706340800 10000000:01000000:0.0:1787787440.856515:0:14443:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787787440.856518:0:14443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9d0706340800 from 1 10000000:01000000:0.0:1787787440.856521:0:14443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787787440.856537:0:14443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d07059fda00/0xdeb1953cba4b20bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787440.856545:0:14443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d07059fda00/0xdeb1953cba4b20bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787440.856553:0:14443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d07059fda00/0xdeb1953cba4b20bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787440.856743:0:14443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e4b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14443:1874630694489344:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787787440.856773:0:14443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787440.856795:0:14443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07058a33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787440.856944:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694489344 00000100:00100000:2.0:1787787440.856948:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694489344 00000100:00100000:2.0:1787787440.856983:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787787440.856990:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072de4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+6:14443:x1874630694489344:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787787440.856998:0:14454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787440.857009:0:14454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d073fd39200/0xdeb1953cba4b20c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b20bb expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787440.857025:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d073fd39200/0xdeb1953cba4b20c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b20bb expref: 7 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787440.857046:0:14454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d073fd39200/0xdeb1953cba4b20c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b20bb expref: 7 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787440.857052:0:14454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd39200, rc 0) 00000100:00100000:2.0:1787787440.857169:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072de4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+7:14443:x1874630694489344:12345-0@lo:101:mount.lustre.0 Request processed in 179us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787440.857176:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787787440.857708:0:14443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e4b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14443:1874630694489344:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787787440.857721:0:14443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d07059fda00/0xdeb1953cba4b20bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b20c2 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.857730:0:14443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d07059fda00/0xdeb1953cba4b20bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b20c2 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787440.857755:0:14443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787787440.857806:0:14443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d07059fda00/0xdeb1953cba4b20bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b20c2 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.857814:0:14443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d07059fda00/0xdeb1953cba4b20bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b20c2 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787440.857821:0:14443:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787787440.857826:0:14443:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787787440.857831:0:14443:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9d0706340800 10000000:01000000:1.0:1787787440.857834:0:14443:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787787440.857839:0:14443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787787440.857841:0:14443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787787440.857862:0:14443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d400/0xdeb1953cba4b20c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.857868:0:14443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d400/0xdeb1953cba4b20c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.857877:0:14443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d400/0xdeb1953cba4b20c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787440.858167:0:14443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14443:1874630694489472:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787787440.858205:0:14443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787440.858238:0:14443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070860f840 going to sleep for 11 seconds 00000100:00100000:2.0:1787787440.858295:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694489472 00000100:00100000:2.0:1787787440.858300:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694489472 00000100:00100000:2.0:1787787440.858338:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787787440.858345:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072de4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+7:14443:x1874630694489472:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787787440.858354:0:14453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787440.858365:0:14453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d073fd38200/0xdeb1953cba4b20d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b20c9 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787440.858380:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d073fd38200/0xdeb1953cba4b20d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b20c9 expref: 8 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787440.858389:0:14453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d073fd38200/0xdeb1953cba4b20d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b20c9 expref: 8 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787440.858395:0:14453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd38200, rc 0) 00000100:00100000:2.0:1787787440.858452:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072de4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+8:14443:x1874630694489472:12345-0@lo:101:mount.lustre.0 Request processed in 91us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787440.858459:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787787440.858757:0:14443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14443:1874630694489472:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787787440.858769:0:14443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d400/0xdeb1953cba4b20c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b20d0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.858786:0:14443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d400/0xdeb1953cba4b20c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b20d0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787440.858831:0:14443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14443:1874630694489600:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787440.858856:0:14443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787440.858952:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694489600 00000100:00100000:2.0:1787787440.858957:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694489600 00000100:00100000:2.0:1787787440.858989:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787787440.858996:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072de4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+8:14443:x1874630694489600:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787440.859355:0:14443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070860f840 going to sleep for 11 seconds 00000100:00100000:2.0:1787787440.859737:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072de4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+9:14443:x1874630694489600:12345-0@lo:501:mount.lustre.0 Request processed in 739us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787440.859745:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787787440.860049:0:14443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14443:1874630694489600:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787440.860085:0:14443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14443:1874630694489728:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787787440.860138:0:14443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787440.860169:0:14443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070860f840 going to sleep for 11 seconds 00000100:00100000:3.0:1787787440.860237:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694489728 00000100:00100000:3.0:1787787440.860242:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694489728 00000100:00100000:3.0:1787787440.860312:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787787440.860320:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072de4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+9:14443:x1874630694489728:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787787440.860678:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072de4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+9:14443:x1874630694489728:12345-0@lo:503:mount.lustre.0 Request processed in 358us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787440.860685:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787787440.860766:0:14443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14443:1874630694489728:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787787440.862380:0:14478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14478:1874630694489856:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787440.862478:0:14478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787440.862513:0:14478:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070860f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787440.863044:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694489856 00000100:00100000:3.0:1787787440.863052:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694489856 00000100:00100000:3.0:1787787440.863108:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787787440.863118:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072de4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+9:14478:x1874630694489856:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787787440.863435:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072de4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+9:14478:x1874630694489856:12345-0@lo:502:llog_process_th.0 Request processed in 318us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787440.863464:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787787440.863769:0:14478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14478:1874630694489856:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787787440.863799:0:14478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787787440.863810:0:14478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787440.863812:0:14478:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787787440.863818:0:14478:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787787440.863822:0:14478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787787440.863835:0:14478:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9d07092d99b8) 00000020:00000080:1.0:1787787440.863852:0:14478:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787787440.863856:0:14478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787787440.863932:0:14478:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787787440.863939:0:14478:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdeb1953cba4b20de 00000020:00000080:1.0:1787787440.864252:0:14478:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787787440.864257:0:14478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787787440.864260:0:14478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787440.864262:0:14478:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787787440.864264:0:14478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787787440.864268:0:14478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787440.864270:0:14478:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787787440.864273:0:14478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787787440.864280:0:14478:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9d07092db370) 00000020:00000080:1.0:1787787440.864290:0:14478:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787787440.864293:0:14478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787787440.864295:0:14478:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787787440.864298:0:14478:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787787440.864302:0:14478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787787440.864337:0:14478:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d0706340800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787787440.864349:0:14478:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9d07092dcd28) 00000020:00000080:1.0:1787787440.864356:0:14478:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787787440.864406:0:14478:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787787440.864411:0:14478:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdeb1953cba4b20f3 00000020:00000080:1.0:1787787440.864590:0:14478:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787787440.864660:0:14478:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787787440.864667:0:14478:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xdeb1953cba4b20fa 00080000:01000000:1.0:1787787440.864673:0:14478:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787787440.864676:0:14478:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdeb1953cba4b2101 00010000:00010000:2.0:1787787440.917239:0:14478:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787787440.917730:0:14478:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1787787440.917907:0:14478:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787787440.918553:0:14478:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9d070312cd28) 00000020:00000080:2.0:1787787440.918571:0:14478:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787787440.918631:0:14478:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787787440.918642:0:14478:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdeb1953cba4b210f 00000020:00000080:2.0:1787787440.919066:0:14478:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787787440.924757:0:14478:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xdeb1953cba4b2116 00000020:00000080:0.0:1787787440.925477:0:14478:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787787440.925488:0:14478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787440.925494:0:14478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787440.925496:0:14478:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787787440.925500:0:14478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787787440.925503:0:14478:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1787787440.925505:0:14478:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787787440.925506:0:14478:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787787440.925507:0:14478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787787440.925510:0:14478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787440.925511:0:14478:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787787440.925514:0:14478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787440.925517:0:14478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787440.925519:0:14478:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787787440.925522:0:14478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787787440.925570:0:14478:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787787440.925588:0:14478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787440.925591:0:14478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787440.925593:0:14478:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787787440.925595:0:14478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787787440.925599:0:14478:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787787440.925602:0:14478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787440.925603:0:14478:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787787440.925606:0:14478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787787440.925611:0:14478:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.110@tcp to nid 0x20000c0a8ce6e (192.168.206.110@tcp) 00000020:01000000:0.0:1787787440.925637:0:14478:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787787440.925641:0:14478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787787440.925659:0:14478:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9d072dfb8000) 00000020:00000080:0.0:1787787440.925672:0:14478:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1787787440.925677:0:14478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787787440.925728:0:14478:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787787440.925734:0:14478:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787787440.925740:0:14478:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdeb1953cba4b2124 00010000:00080000:0.0:1787787440.925769:0:14478:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d0707d5b000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.110@tcp at head 00010000:00010000:0.0:1787787440.925978:0:14478:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1787787440.926764:0:14478:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787787440.926810:0:14478:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787787440.930379:0:14478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787787440.931178:0:14478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1787787440.931270:0:14478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787787440.931659:0:14482:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787787440.931664:0:14482:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787787440.932359:0:14478:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787787440.932371:0:14478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787787440.932402:0:14478:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787787440.932420:0:14478:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdeb1953cba4b212b 00000100:00080000:0.0:1787787440.932430:0:14478:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787787440.932477:0:14478:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d0707d5b000 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:0.0:1787787440.932510:0:14478:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0737e48f00 x1874630694489984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787787440.932533:0:14478:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787787440.932591:0:14478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787440.932596:0:14478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787440.932597:0:14478:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787787440.932601:0:14478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787787440.932603:0:14478:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787787440.932605:0:14478:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787787440.932606:0:14478:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787787440.932607:0:14478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787787440.932610:0:14478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787440.932617:0:14478:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787787440.932621:0:14478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787787440.932625:0:14478:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787787440.932628:0:14478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787440.932629:0:14478:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787787440.932632:0:14478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787787440.932636:0:14478:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.110@tcp to nid 0x20000c0a8ce6e (192.168.206.110@tcp) 00000020:01000000:0.0:1787787440.932658:0:14478:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787787440.932661:0:14478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787787440.932671:0:14478:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9d072dfbcd28) 00000020:00000080:0.0:1787787440.932682:0:14478:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1787787440.932686:0:14478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787787440.932738:0:14478:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787787440.932744:0:14478:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787787440.932750:0:14478:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdeb1953cba4b2139 00010000:00080000:0.0:1787787440.932779:0:14478:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d0603728000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.110@tcp at head 00010000:00010000:0.0:1787787440.932980:0:14478:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1787787440.933587:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1874630694489984:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787787440.933645:0:3290:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874630694489984 offset 0 length 520: 4 00000040:01000000:0.0:1787787440.934228:0:14478:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787787440.934250:0:14478:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787787440.934981:0:14478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787787440.935042:0:14478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1787787440.935182:0:14478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1787787440.935659:0:14484:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787787440.935665:0:14484:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787787440.936318:0:14478:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787787440.936330:0:14478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787787440.936358:0:14478:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787787440.936374:0:14478:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdeb1953cba4b2140 00000100:00080000:0.0:1787787440.936385:0:14478:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787787440.936391:0:14478:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d0603728000 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:0.0:1787787440.936422:0:14478:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0737e4b840 x1874630694490112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787787440.936654:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e4b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1874630694490112:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787787440.936704:0:3290:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874630694490112 offset 0 length 520: 4 00000100:00080000:0.0:1787787440.936755:0:14478:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787787440.936817:0:14478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787440.936821:0:14478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787440.936823:0:14478:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787787440.936827:0:14478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787440.936831:0:14478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787440.936832:0:14478:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787787440.936835:0:14478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787787440.936837:0:14478:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787787440.936839:0:14478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787440.936841:0:14478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787440.936842:0:14478:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787787440.936844:0:14478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787440.936846:0:14478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787440.936847:0:14478:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787787440.936851:0:14478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787787440.936878:0:14478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e48000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14478:1874630694490240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787787440.936926:0:14478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787440.936946:0:14478:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0601aad900 going to sleep for 11 seconds 00000100:00100000:3.0:1787787440.937077:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694490240 00000100:00100000:3.0:1787787440.937084:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694490240 00000100:00100000:3.0:1787787440.937215:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787787440.937225:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072de4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+9:14478:x1874630694490240:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787787440.937473:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072de4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+9:14478:x1874630694490240:12345-0@lo:502:llog_process_th.0 Request processed in 248us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787440.937481:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787787440.937562:0:14478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e48000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14478:1874630694490240:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787787440.937587:0:14478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787787440.937592:0:14478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787440.937594:0:14478:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787787440.937598:0:14478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1787787440.937771:0:14443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1787787440.937789:0:14443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787787440.937812:0:14443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d400/0xdeb1953cba4b20c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b20d0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.937823:0:14443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d400/0xdeb1953cba4b20c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b20d0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787440.937831:0:14443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d0706340800 from 1 10000000:01000000:1.0:1787787440.937841:0:14443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787787440.937866:0:14443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d600/0xdeb1953cba4b2147 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.937874:0:14443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d600/0xdeb1953cba4b2147 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.937883:0:14443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d600/0xdeb1953cba4b2147 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787440.937898:0:14443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14443:1874630694490368:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787787440.937928:0:14443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787440.938101:0:14443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070860ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787787440.938254:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694490368 00000100:00100000:0.0:1787787440.938259:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694490368 00000100:00100000:0.0:1787787440.938283:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787787440.938290:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072de4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+9:14443:x1874630694490368:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787787440.938301:0:14454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787440.938314:0:14454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d07059fd000/0xdeb1953cba4b214e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b2147 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787440.938334:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d07059fd000/0xdeb1953cba4b214e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b2147 expref: 10 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787440.938343:0:14454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d07059fd000/0xdeb1953cba4b214e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b2147 expref: 10 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787440.938361:0:14454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d07059fd000, rc 0) 00000100:00100000:0.0:1787787440.938401:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072de4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+10:14443:x1874630694490368:12345-0@lo:101:mount.lustre.0 Request processed in 112us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787440.938407:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787787440.938579:0:14443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14443:1874630694490368:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787787440.938591:0:14443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d600/0xdeb1953cba4b2147 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b214e expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.938601:0:14443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d600/0xdeb1953cba4b2147 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b214e expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787440.939194:0:14443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14443:1874630694490496:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787787440.939237:0:14443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787440.939269:0:14443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070860ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787787440.939329:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694490496 00000100:00100000:0.0:1787787440.939334:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694490496 00000100:00100000:0.0:1787787440.939367:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787787440.939375:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07346c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+10:14443:x1874630694490496:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787787440.939389:0:14454:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787787440.939395:0:14454:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787787440.939493:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07346c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+10:14443:x1874630694490496:12345-0@lo:256:mount.lustre.0 Request processed in 119us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787440.939501:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787787440.939649:0:14443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14443:1874630694490496:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1787787440.940290:0:14443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787787440.940360:0:14443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d600/0xdeb1953cba4b2147 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b214e expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.940405:0:14443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d600/0xdeb1953cba4b2147 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b214e expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787440.940413:0:14443:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d0706340800 from 1 10000000:01000000:1.0:1787787440.940416:0:14443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787787440.940467:0:14443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0737a1c000/0xdeb1953cba4b2155 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.940475:0:14443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d0737a1c000/0xdeb1953cba4b2155 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.940484:0:14443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d0737a1c000/0xdeb1953cba4b2155 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787440.940500:0:14443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14443:1874630694490624:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787787440.940537:0:14443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787440.940565:0:14443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070860ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787787440.940594:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694490624 00000100:00100000:1.0:1787787440.940599:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694490624 00000100:00100000:1.0:1787787440.940631:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787787440.940638:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07346c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+10:14443:x1874630694490624:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787787440.940648:0:14454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787440.940661:0:14454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0737a1d800/0xdeb1953cba4b215c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b2155 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.940692:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0737a1d800/0xdeb1953cba4b215c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b2155 expref: 11 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.940712:0:14454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0737a1d800/0xdeb1953cba4b215c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b2155 expref: 11 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.940720:0:14454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1d800, rc 0) 00000100:00100000:1.0:1787787440.940752:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07346c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+11:14443:x1874630694490624:12345-0@lo:101:mount.lustre.0 Request processed in 115us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787440.940758:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787787440.940796:0:14443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14443:1874630694490624:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787787440.940809:0:14443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d0737a1c000/0xdeb1953cba4b2155 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b215c expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.940818:0:14443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d0737a1c000/0xdeb1953cba4b2155 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b215c expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787440.940859:0:14443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14443:1874630694490752:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787440.940883:0:14443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787440.940896:0:14443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070860ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787787440.940908:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694490752 00000100:00100000:1.0:1787787440.940911:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694490752 00000100:00100000:1.0:1787787440.940926:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787787440.940931:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07346c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+11:14443:x1874630694490752:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787440.941314:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07346c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+11:14443:x1874630694490752:12345-0@lo:501:mount.lustre.0 Request processed in 381us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787440.941321:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787787440.941352:0:14443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14443:1874630694490752:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787440.941385:0:14443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14443:1874630694490880:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787787440.941419:0:14443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787440.941431:0:14443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073d9bcc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787787440.941467:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694490880 00000100:00100000:1.0:1787787440.941471:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694490880 00000100:00100000:1.0:1787787440.941488:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787787440.941494:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07346c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+11:14443:x1874630694490880:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787787440.941618:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07346c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+11:14443:x1874630694490880:12345-0@lo:503:mount.lustre.0 Request processed in 124us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787440.941625:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787787440.941663:0:14443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14443:1874630694490880:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787787440.942389:0:14486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14486:1874630694491008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787440.942433:0:14486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787440.942751:0:14486:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07062240c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787440.942781:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694491008 00000100:00100000:1.0:1787787440.942787:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694491008 00000100:00100000:1.0:1787787440.942846:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787787440.942854:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07346cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+11:14486:x1874630694491008:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787440.943054:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07346cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+11:14486:x1874630694491008:12345-0@lo:502:llog_process_th.0 Request processed in 201us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787440.943062:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787787440.943184:0:14486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14486:1874630694491008:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787787440.943217:0:14486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787440.943226:0:14486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787440.943228:0:14486:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787787440.943235:0:14486:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d0706340800 00000020:00000080:3.0:1787787440.943237:0:14486:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787787440.943245:0:14486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787440.943247:0:14486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787440.943249:0:14486:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787787440.943251:0:14486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787440.943253:0:14486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787440.943255:0:14486:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787787440.943258:0:14486:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d0706340800 00000020:00000080:3.0:1787787440.943261:0:14486:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787787440.943315:0:14486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787440.943319:0:14486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787440.943320:0:14486:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787787440.943323:0:14486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787440.943325:0:14486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787440.943327:0:14486:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787787440.943330:0:14486:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d0706340800 00000020:00000080:3.0:1787787440.943332:0:14486:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787787440.943367:0:14486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07059743c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14486:1874630694491136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787787440.943401:0:14486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787440.946338:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694491136 00000100:00100000:2.0:1787787440.946350:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694491136 00000100:00100000:2.0:1787787440.946400:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787787440.946409:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07346c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+11:14486:x1874630694491136:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787440.947003:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07346c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+11:14486:x1874630694491136:12345-0@lo:502:llog_process_th.0 Request processed in 413us (3418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787440.950810:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787787440.950823:0:14486:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07053b7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787787440.950856:0:14486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07059743c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14486:1874630694491136:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787787440.950894:0:14486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787440.950902:0:14486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787440.950905:0:14486:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787787440.950909:0:14486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787787440.951161:0:14443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787787440.951181:0:14443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787787440.951207:0:14443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0737a1c000/0xdeb1953cba4b2155 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b215c expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.951219:0:14443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d0737a1c000/0xdeb1953cba4b2155 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b215c expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787440.951274:0:14443:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787787440.951277:0:14443:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d0706340800 10000000:01000000:1.0:1787787440.951280:0:14443:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d0706340800 10000000:01000000:1.0:1787787440.951284:0:14443:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787787440.951288:0:14443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d0706340800 from 1 10000000:01000000:1.0:1787787440.951291:0:14443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787787440.951321:0:14443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0737a1ca00/0xdeb1953cba4b2163 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.951329:0:14443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d0737a1ca00/0xdeb1953cba4b2163 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.951338:0:14443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d0737a1ca00/0xdeb1953cba4b2163 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787440.951357:0:14443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14443:1874630694491264:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787787440.951408:0:14443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787440.951457:0:14443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073d9bc600 going to sleep for 11 seconds 00000100:00100000:1.0:1787787440.951474:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694491264 00000100:00100000:1.0:1787787440.951888:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694491264 00000100:00100000:1.0:1787787440.951965:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787787440.951975:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07346cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+11:14443:x1874630694491264:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787787440.951989:0:14454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787440.952002:0:14454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0737a1de00/0xdeb1953cba4b216a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b2163 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.952024:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0737a1de00/0xdeb1953cba4b216a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b2163 expref: 12 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.952045:0:14454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0737a1de00/0xdeb1953cba4b216a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b2163 expref: 12 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.952053:0:14454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1de00, rc 0) 00000100:00100000:1.0:1787787440.952109:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07346cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+12:14443:x1874630694491264:12345-0@lo:101:mount.lustre.0 Request processed in 136us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787440.952116:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787787440.952260:0:14443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14443:1874630694491264:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787787440.952274:0:14443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d0737a1ca00/0xdeb1953cba4b2163 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b216a expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787440.952283:0:14443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d0737a1ca00/0xdeb1953cba4b2163 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b216a expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787440.952326:0:14443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14443:1874630694491392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787440.952351:0:14443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787440.952412:0:14443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073d9bc600 going to sleep for 11 seconds 00000100:00100000:2.0:1787787440.955817:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694491392 00000100:00100000:2.0:1787787440.955901:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694491392 00000100:00100000:2.0:1787787440.955951:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787787440.955960:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07346ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+12:14443:x1874630694491392:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787787440.957044:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07346ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+12:14443:x1874630694491392:12345-0@lo:501:mount.lustre.0 Request processed in 1081us (4687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787440.957055:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787787440.957213:0:14443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14443:1874630694491392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787440.957257:0:14443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14443:1874630694491520:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787787440.957304:0:14443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787440.957332:0:14443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073d9bc600 going to sleep for 11 seconds 00000100:00100000:1.0:1787787440.957347:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694491520 00000100:00100000:1.0:1787787440.957351:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694491520 00000100:00100000:1.0:1787787440.957419:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787787440.957427:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07346cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+12:14443:x1874630694491520:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787787440.957635:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07346cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+12:14443:x1874630694491520:12345-0@lo:503:mount.lustre.0 Request processed in 208us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787440.957642:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787787440.958156:0:14443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14443:1874630694491520:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787787440.958808:0:14491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dfc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14491:1874630694491648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787440.958920:0:14491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787440.958946:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694491648 00000100:00100000:2.0:1787787440.958951:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694491648 00000100:00100000:2.0:1787787440.958978:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787787440.958984:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07346c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+12:14491:x1874630694491648:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787440.959225:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07346c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+12:14491:x1874630694491648:12345-0@lo:502:llog_process_th.0 Request processed in 239us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787440.959232:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787787440.959274:0:14491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070693e180 going to sleep for 11 seconds 00000100:00100000:2.0:1787787440.959288:0:14491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dfc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14491:1874630694491648:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787787440.959335:0:14491:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787787440.959347:0:14491:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9d0703128000) 00000020:00000080:2.0:1787787440.959363:0:14491:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1787787440.959423:0:14491:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d0706340800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787787440.959431:0:14491:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d0706340800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787787440.959433:0:14491:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d0706340800 4 00010000:00080000:2.0:1787787440.959785:0:14491:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d072764a800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.110@tcp at head 00010000:00010000:2.0:1787787440.964970:0:14491:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1787787440.965261:0:14491:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787787440.965297:0:14491:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787787440.965309:0:14491:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xdeb1953cba4b2178 00000100:00080000:2.0:1787787440.965319:0:14491:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787787440.965324:0:14491:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9d072764a800 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:2.0:1787787440.965356:0:14491:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d071b1dfc00 x1874630694491776/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787787440.965386:0:14491:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787787440.965551:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1874630694491776:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787787440.965686:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787440.965775:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694491776 00000100:00100000:2.0:1787787440.965787:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694491776 00000100:00100000:2.0:1787787440.965886:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787787440.965894:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07059743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3290:x1874630694491776:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787787440.965946:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07059743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3290:x1874630694491776:12345-0@lo:38:llog_process_th.0 Request processed in 52us (260us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787787440.965954:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787787440.966221:0:3290:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787787440.966228:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9d072764a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787787440.966233:0:3290:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787787440.966236:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1874630694491776:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787787440.966399:0:14491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14491:1874630694491904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787440.966469:0:14491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787440.966504:0:14491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073d9bc600 going to sleep for 11 seconds 00000100:00100000:3.0:1787787440.966790:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694491904 00000100:00100000:3.0:1787787440.966795:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694491904 00000100:00100000:3.0:1787787440.966839:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787787440.966847:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07346c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+12:14491:x1874630694491904:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787787440.967132:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07346c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+12:14491:x1874630694491904:12345-0@lo:502:llog_process_th.0 Request processed in 285us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787440.967140:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787787440.967392:0:14491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14491:1874630694491904:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787787440.967493:0:14491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787787440.967825:0:14443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787787440.967848:0:14443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787787440.967899:0:14443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0737a1ca00/0xdeb1953cba4b2163 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b216a expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787440.967982:0:14443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d0737a1ca00/0xdeb1953cba4b2163 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b216a expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787787440.968025:0:14443:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787787440.968027:0:14443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787787440.968029:0:14443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787787440.968030:0:14443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787787440.968031:0:14443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787787440.968032:0:14443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787787440.968034:0:14443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787787440.968035:0:14443:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787787440.968037:0:14443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787787440.968038:0:14443:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787787440.968046:0:14443:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1787787440.968048:0:14443:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787787440.968049:0:14443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787787440.968050:0:14443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787787440.968051:0:14443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787787440.968052:0:14443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787787440.968053:0:14443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787787440.968054:0:14443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787787440.968060:0:14443:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787787440.968061:0:14443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787787440.968062:0:14443:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787787440.968079:0:14443:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787787440.968105:0:14443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0705974b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14443:1874630694492032:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787787440.968158:0:14443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787440.968190:0:14443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07053b7540 going to sleep for 11 seconds 00000100:00100000:2.0:1787787440.968232:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694492032 00000100:00100000:2.0:1787787440.968237:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694492032 00000100:00100000:2.0:1787787440.968302:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787787440.968310:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07346ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+12:14443:x1874630694492032:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787787440.968332:0:14453:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787787440.968344:0:14453:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787787441.001630:0:14453:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787787441.001643:0:14453:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787787441.001684:0:14476:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787787441.001700:0:14476:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787787441.001719:0:14476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d073fd38400/0xdeb1953cba4b217f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.001835:0:14476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d07059fd000/0xdeb1953cba4b214e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b2147 expref: 12 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.001845:0:14476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d073fd38400/0xdeb1953cba4b217f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.001880:0:14476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d07059fd000/0xdeb1953cba4b214e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b2147 expref: 12 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.001893:0:14476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d07059fd000/0xdeb1953cba4b214e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b2147 expref: 12 pid: 14454 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787441.001908:0:14476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1de580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14476:1874630694492160:0@lo:104: 00000100:00100000:2.0:1787787441.002049:0:14476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787441.002143:0:14476:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070693e000 going to sleep for 11 seconds 00000100:00100000:2.0:1787787441.007181:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07346ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+12:14443:x1874630694492032:12345-0@lo:253:mount.lustre.0 Request processed in 38864us (39015us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787441.007194:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787787441.007372:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694492160 00000100:00100000:0.0:1787787441.007380:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694492160 00000100:00100000:0.0:1787787441.007495:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787787441.007505:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+3:14476:x1874630694492160:12345-0@lo:104: 00010000:00010000:0.0:1787787441.007522:0:14444:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d600/0xdeb1953cba4b2147 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b214e expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.007577:0:14444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787787441.007583:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+3:14476:x1874630694492160:12345-0@lo:104: Request processed in 81us (5535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787441.007590:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787787441.007650:0:14443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0705974b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14443:1874630694492032:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787787441.007664:0:14443:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787787441.007667:0:14443:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787787441.007669:0:14443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787787441.007670:0:14443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787787441.007671:0:14443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787787441.007673:0:14443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787787441.007674:0:14443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787787441.007675:0:14443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787787441.007677:0:14443:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787787441.007678:0:14443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787787441.007680:0:14443:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787787441.007694:0:14443:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1787787441.008060:0:14476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1de580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14476:1874630694492160:0@lo:104: 00010000:00010000:2.0:1787787441.008076:0:14476:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d073fd38400/0xdeb1953cba4b217f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.010493:0:14450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787441.010506:0:14450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d600/0xdeb1953cba4b2147 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b214e expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.010534:0:14450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1d600 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:0.0:1787787441.010539:0:14450:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d600/0xdeb1953cba4b2147 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b214e expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.010549:0:14450:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d600/0xdeb1953cba4b2147 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b214e expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787787441.010557:0:14450:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d600/0xdeb1953cba4b2147 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b214e expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787441.010563:0:14450:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787787441.010617:0:14450:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d600/0xdeb1953cba4b2147 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b214e expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1787787441.013151:0:14443:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1787787441.013328:0:14443:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787787441.013659:0:14443:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1787787441.013897:0:14443:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787787441.014270:0:14443:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787787441.014424:0:14443:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00010000:00010000:0.0:1787787441.015190:0:14450:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787787441.015222:0:14450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d600/0xdeb1953cba4b2147 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b214e expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.015230:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d600/0xdeb1953cba4b2147 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b214e expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.015248:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787441.015250:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787441.015252:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787441.015502:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e48b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:3291:1874630694492288:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787441.015566:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787441.015768:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694492288 00000100:00100000:0.0:1787787441.015775:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694492288 00010000:00010000:0.0:1787787441.015922:0:14446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d07059fd000/0xdeb1953cba4b214e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b2147 expref: 12 pid: 14454 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787441.016003:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787787441.016019:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1de580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+12:3291:x1874630694492288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787787441.016032:0:14446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787441.016038:0:14446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d07059fd000/0xdeb1953cba4b214e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b2147 expref: 12 pid: 14454 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.016051:0:14446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d07059fd000/0xdeb1953cba4b214e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b2147 expref: 12 pid: 14454 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.016067:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d07059fd000/0xdeb1953cba4b214e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b2147 expref: 12 pid: 14454 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.016080:0:14446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d073fd38400/0xdeb1953cba4b217f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.016099:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d073fd38400/0xdeb1953cba4b217f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787787441.016114:0:14446:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014415966s 00010000:00010000:0.0:1787787441.016119:0:14446:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d073fd38400/0xdeb1953cba4b217f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.016126:0:14446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d073fd38400/0xdeb1953cba4b217f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.016133:0:14446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d073fd38400/0xdeb1953cba4b217f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.016138:0:14446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d073fd38400/0xdeb1953cba4b217f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.016143:0:14446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd38400 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:0.0:1787787441.016153:0:14446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d073fd38400/0xdeb1953cba4b217f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.016161:0:14446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d073fd38400/0xdeb1953cba4b217f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.016184:0:14446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d073fd38400/0xdeb1953cba4b217f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787441.016195:0:14446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787441.016246:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1de580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+11:3291:x1874630694492288:12345-0@lo:103:ldlm_bl.0 Request processed in 229us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787441.016254:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00080000:10000000:0.0:1787787441.016312:0:14443:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787787441.016566:0:14443:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00000100:00100000:1.0:1787787441.016873:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e48b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:3291:1874630694492288:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787787441.017024:0:14476:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d073fd38400/0xdeb1953cba4b217f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.017044:0:14476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d073fd38400/0xdeb1953cba4b217f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.017050:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d073fd38400/0xdeb1953cba4b217f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1787787441.017197:0:14443:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787787441.017418:0:14443:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787787441.018137:0:14443:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787787441.018303:0:14443:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1787787441.074424:0:14443:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1787787441.075049:0:14443:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787787441.075248:0:14497:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1787787441.075252:0:14497:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1787787441.078239:0:14498:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1787787441.078355:0:14498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787787441.080780:0:14498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787787441.080868:0:14498:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787787441.080873:0:14498:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1787787441.087369:0:14443:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787787441.087517:0:14443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787787441.088192:0:14443:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787787441.088200:0:14443:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787787441.088340:0:14443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787787441.089969:0:14443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787787441.090695:0:14443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787787441.090862:0:14443:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1787787441.092323:0:14443:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1787787441.096979:0:14443:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1787787441.128072:0:14443:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787787441.128128:0:14443:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb6cdc1cbb988 00100000:10000000:3.0:1787787441.128137:0:14443:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787787441.128846:0:14443:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787787441.128862:0:14443:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.110@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787787441.128877:0:14443:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1787787441.128899:0:14443:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1787787441.724819:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787787441.980573:0:14458:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787787441.980580:0:14458:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d0706340800 from 6 10000000:01000000:2.0:1787787441.980595:0:14458:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787787441.980641:0:14458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d073fd39000/0xdeb1953cba4b2186 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.980653:0:14458:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d073fd39000/0xdeb1953cba4b2186 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.980664:0:14458:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d073fd39000/0xdeb1953cba4b2186 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787441.980690:0:14458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1ded00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694492416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787787441.980759:0:14458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787441.980824:0:14458:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07033b86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787441.980867:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694492416 00000100:00100000:3.0:1787787441.980874:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694492416 00000100:00100000:3.0:1787787441.980932:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787787441.980942:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07346cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+11:14458:x1874630694492416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787787441.980955:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787441.980970:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b218d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b2186 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.980992:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b218d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b2186 expref: 12 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.981002:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b218d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b2186 expref: 12 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787441.981011:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708770800, rc 0) 00000100:00100000:3.0:1787787441.981065:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07346cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+12:14458:x1874630694492416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787441.981072:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787787441.981350:0:14458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1ded00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694492416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787441.981366:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d073fd39000/0xdeb1953cba4b2186 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b218d expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787441.981375:0:14458:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d073fd39000/0xdeb1953cba4b2186 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b218d expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787441.981420:0:14458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1ded00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694492544:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787787441.981487:0:14458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787441.981518:0:14458:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07033b86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787441.981787:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694492544 00000100:00100000:3.0:1787787441.981792:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694492544 00000100:00100000:3.0:1787787441.981818:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787787441.981825:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07346c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+12:14458:x1874630694492544:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787787441.981840:0:14453:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787787441.981856:0:14453:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787787441.981859:0:14453:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1787787441.981973:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07346c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+12:14458:x1874630694492544:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 147us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787441.981981:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787787441.982001:0:14458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1ded00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694492544:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787787441.982041:0:14458:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787787441.982048:0:14458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d073fd39000/0xdeb1953cba4b2186 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b218d expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787441.982056:0:14458:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d073fd39000/0xdeb1953cba4b2186 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b218d expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787787441.985988:0:14492:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787787442.750690:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787787443.006134:0:14492:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787787443.773564:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787787444.531685:0:14741:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787787444.797579:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787445.820558:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787787446.142216:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787787446.142223:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787787446.142226:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787787446.142229:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787787446.142231:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787787446.142234:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787787446.142238:0:37:0:(import.c:65:import_set_state_nolock()) ffff9d072764a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787787446.142250:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9d072764a800 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:2.0:1787787446.142272:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d071b1dc000 x1874630694492800/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787787446.142324:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1874630694492800:0@lo:38:kworker.0 00000100:00100000:2.0:1787787446.142392:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787446.142541:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787787446.142559:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:3291:1874630694492672:0@lo:400:kworker.0 00000100:00100000:1.0:1787787446.142594:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787446.142630:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694492672 00000100:00100000:1.0:1787787446.142636:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694492672 00000100:00100000:1.0:1787787446.142673:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787787446.142682:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07346cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+12:3291:x1874630694492672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787446.142740:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07346cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+12:3291:x1874630694492672:12345-0@lo:400:kworker.0 Request processed in 59us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787446.142748:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787787446.142790:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:3291:1874630694492672:0@lo:400:kworker.0 00000100:00100000:3.0:1787787446.144367:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694492800 00000100:00100000:3.0:1787787446.144378:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694492800 00000100:00100000:3.0:1787787446.144408:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787787446.144414:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3290:x1874630694492800:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787787446.144456:0:14462:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 358 last 0 00000020:00000080:3.0:1787787446.144489:0:14462:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xdeb1953cba4b2194 00000004:00100000:3.0:1787787446.144504:0:14462:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787787446.144637:0:14462:0:(import.c:65:import_set_state_nolock()) ffff9d0734135800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787787446.144723:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1874630694492800:12345-0@lo:38:kworker.0 Request processed in 306us (2329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787446.144731:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787787446.144907:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d071b1dc000 x1874630694492800/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787787456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787787446.144923:0:3290:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787787446.144931:0:3290:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787787446.144936:0:3290:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787787446.144938:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9d072764a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787787446.144944:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1874630694492800:0@lo:38:kworker.0 00010000:00010000:1.0:1787787446.844964:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787787447.073085:0:14891:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffccca7de10 20000000:00000080:1.0:1787787447.073104:0:14891:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d072e8b2800 uarg=0000000000000000 20000000:01000000:1.0:1787787447.073135:0:14891:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787787447.073142:0:14891:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787787447.073147:0:14891:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787787447.080802:0:14892:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1787787447.081109:0:14891:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787787447.089326:0:14891:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787787447.089357:0:14891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d07059fd000/0xdeb1953cba4b219b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787447.089375:0:14891:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0737a1d800/0xdeb1953cba4b215c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b2155 expref: 11 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787447.089403:0:14891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d07059fd000/0xdeb1953cba4b219b lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787447.089659:0:14891:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0737a1d800/0xdeb1953cba4b215c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b2155 expref: 11 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787447.089675:0:14891:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d0737a1d800/0xdeb1953cba4b215c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b2155 expref: 11 pid: 14454 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787447.089689:0:14891:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e4b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14891:1874630694492928:0@lo:104: 00000100:00100000:0.0:1787787447.089761:0:14891:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787447.089821:0:14891:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07093d5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787787447.090026:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694492928 00000100:00100000:1.0:1787787447.090034:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694492928 00000100:00100000:1.0:1787787447.090096:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787787447.090107:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+3:14891:x1874630694492928:12345-0@lo:104: 00010000:00010000:1.0:1787787447.090119:0:14445:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9d0737a1c000/0xdeb1953cba4b2155 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b215c expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787447.090185:0:14445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787787447.090192:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+3:14891:x1874630694492928:12345-0@lo:104: Request processed in 88us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787447.090199:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787787447.090219:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787447.090232:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d0737a1c000/0xdeb1953cba4b2155 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b215c expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787447.090240:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1c000 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:1.0:1787787447.090243:0:14449:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d0737a1c000/0xdeb1953cba4b2155 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b215c expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787447.090252:0:14449:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d0737a1c000/0xdeb1953cba4b2155 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b215c expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787447.090259:0:14449:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d0737a1c000/0xdeb1953cba4b2155 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b215c expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787447.090265:0:14449:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787787447.090294:0:14449:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d0737a1c000/0xdeb1953cba4b2155 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b215c expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787447.090301:0:14449:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787447.090318:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d0737a1c000/0xdeb1953cba4b2155 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b215c expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787447.090324:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d0737a1c000/0xdeb1953cba4b2155 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b215c expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787447.090340:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787447.090342:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787447.090344:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787447.090372:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:3293:1874630694493056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787787447.090400:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787447.090474:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694493056 00000100:00100000:1.0:1787787447.090484:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694493056 00010000:00010000:1.0:1787787447.090501:0:14448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0737a1d800/0xdeb1953cba4b215c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b2155 expref: 12 pid: 14454 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787447.090525:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787787447.090531:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a08f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+12:3293:x1874630694493056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787787447.090541:0:14448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787447.090546:0:14448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0737a1d800/0xdeb1953cba4b215c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b2155 expref: 12 pid: 14454 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787447.090556:0:14448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0737a1d800/0xdeb1953cba4b215c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b2155 expref: 12 pid: 14454 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787447.090571:0:14448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d07059fd000/0xdeb1953cba4b219b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787447.090578:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d07059fd000/0xdeb1953cba4b219b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787447.090590:0:14448:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d07059fd000/0xdeb1953cba4b219b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787447.090597:0:14448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d07059fd000/0xdeb1953cba4b219b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787447.090602:0:14448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d07059fd000/0xdeb1953cba4b219b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787447.090608:0:14448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d07059fd000/0xdeb1953cba4b219b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787447.090613:0:14448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fd000 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:1.0:1787787447.090623:0:14448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d07059fd000/0xdeb1953cba4b219b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787447.090631:0:14448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d07059fd000/0xdeb1953cba4b219b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787447.090640:0:14448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d07059fd000/0xdeb1953cba4b219b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787447.090649:0:14448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787447.090678:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a08f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+12:3293:x1874630694493056:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787447.090685:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787787447.090952:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:3293:1874630694493056:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787787447.091166:0:14891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0737a1d800/0xdeb1953cba4b215c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b2155 expref: 11 pid: 14454 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787447.091177:0:14891:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e4b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14891:1874630694492928:0@lo:104: 00010000:00010000:2.0:1787787447.091192:0:14891:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d07059fd000/0xdeb1953cba4b219b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787447.091201:0:14891:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d07059fd000/0xdeb1953cba4b219b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787447.091207:0:14891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d07059fd000/0xdeb1953cba4b219b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787447.091213:0:14891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d07059fd000/0xdeb1953cba4b219b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787447.871255:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787448.892841:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787787449.084949:0:14458:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787787449.084956:0:14458:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d0706340800 from 10 10000000:01000000:1.0:1787787449.084961:0:14458:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787787449.085004:0:14458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d200/0xdeb1953cba4b21a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787449.085015:0:14458:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d200/0xdeb1953cba4b21a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787449.085026:0:14458:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d200/0xdeb1953cba4b21a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787449.085061:0:14458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694493184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787787449.085125:0:14458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787449.085180:0:14458:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0706b113c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787449.085241:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694493184 00000100:00100000:3.0:1787787449.085259:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694493184 00000100:00100000:3.0:1787787449.085310:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787787449.085319:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072d8cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+11:14458:x1874630694493184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787787449.085333:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787449.085356:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0708771e00/0xdeb1953cba4b21a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b21a2 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787449.085393:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0708771e00/0xdeb1953cba4b21a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b21a2 expref: 12 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787449.085404:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0708771e00/0xdeb1953cba4b21a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b21a2 expref: 12 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787449.085412:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708771e00, rc 0) 00000100:00100000:3.0:1787787449.085492:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072d8cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+12:14458:x1874630694493184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787449.085499:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787787449.085639:0:14458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694493184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787449.085653:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d200/0xdeb1953cba4b21a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b21a9 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787449.085662:0:14458:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d200/0xdeb1953cba4b21a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b21a9 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787449.085730:0:14458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e4ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694493312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787449.085757:0:14458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787449.085786:0:14458:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070693e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787449.085895:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694493312 00000100:00100000:1.0:1787787449.085907:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694493312 00000100:00100000:1.0:1787787449.085941:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787787449.085947:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072d8cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+12:14458:x1874630694493312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787449.086198:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072d8cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+12:14458:x1874630694493312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787449.086206:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787787449.086238:0:14458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e4ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694493312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787449.086284:0:14458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694493440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787449.086324:0:14458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787449.086339:0:14458:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0706b11540 going to sleep for 11 seconds 00000100:00100000:1.0:1787787449.086351:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694493440 00000100:00100000:1.0:1787787449.086355:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694493440 00000100:00100000:1.0:1787787449.086373:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787787449.086379:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072d8cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+12:14458:x1874630694493440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787449.086543:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072d8cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+12:14458:x1874630694493440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787449.086550:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787787449.086585:0:14458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694493440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787787449.094699:0:14971:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787787449.094935:0:14458:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787787449.094959:0:14458:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787787449.094972:0:14458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d200/0xdeb1953cba4b21a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b21a9 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787449.094985:0:14458:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d200/0xdeb1953cba4b21a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b21a9 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787449.918806:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787450.236615:0:3290:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787787440/real 1787787440] req@ffff9d0737e4b840 x1874630694490112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787450 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787450.236647:0:3290:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d0737e4b840 x1874630694490112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787450 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787450.236688:0:3290:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787787440/real 1787787440] req@ffff9d0737e48f00 x1874630694489984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787450 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787450.236700:0:3290:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d0737e48f00 x1874630694489984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787450 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787787450.236719:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9d0603728000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787787450.236729:0:3290:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787787450.236733:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e4b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1874630694490112:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787787450.236739:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9d0707d5b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787787450.236744:0:3290:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787787450.236747:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1874630694489984:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787787450.237107:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787787450.237113:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787787450.237116:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d0707d5b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1787787450.237122:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07059761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:3294:1874630694493568:0@lo:400:kworker.0 00000100:00080000:3.0:1787787450.237123:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 353 00000100:00080000:3.0:1787787450.237132:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787787450.237141:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d0707d5b000 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:3.0:1787787450.237163:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0705974f00 x1874630694493696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787787450.237180:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787787450.237184:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787787450.237186:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d0603728000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787787450.237189:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 353 00000100:00080000:3.0:1787787450.237192:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787787450.237196:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d0603728000 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:1.0:1787787450.237210:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787450.237226:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0705974b40 x1874630694493824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787787450.237277:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0705974f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1874630694493696:0@lo:8:kworker.0 00000100:00100000:1.0:1787787450.237278:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694493568 00000100:00100000:1.0:1787787450.237287:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694493568 00000400:00000100:3.0:1787787450.237306:0:3290:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874630694493696 offset 0 length 520: 4 00000100:00100000:3.0:1787787450.237326:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0705974b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1874630694493824:0@lo:8:kworker.0 00000100:00100000:1.0:1787787450.237334:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000400:00000100:3.0:1787787450.237342:0:3290:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874630694493824 offset 0 length 520: 4 00000100:00100000:1.0:1787787450.237347:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072d8ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+12:3294:x1874630694493568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787450.237369:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0705976940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1874630694493952:0@lo:400:kworker.0 00000100:00100000:1.0:1787787450.237401:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072d8ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+12:3294:x1874630694493568:12345-0@lo:400:kworker.0 Request processed in 58us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787450.237416:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787787450.237423:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787450.237488:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07059761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:3294:1874630694493568:0@lo:400:kworker.0 00000100:00100000:3.0:1787787450.237495:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694493952 00000100:00100000:3.0:1787787450.237500:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694493952 00000100:00100000:3.0:1787787450.237548:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787787450.237555:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07059752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1874630694493952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787450.237592:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07059752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1874630694493952:12345-0@lo:400:kworker.0 Request processed in 37us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787450.237598:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787787450.237702:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d0705976940 x1874630694493952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787450.237718:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0705976940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1874630694493952:0@lo:400:kworker.0 00010000:00010000:1.0:1787787450.946885:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787787451.453537:0:15140:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787787451.453541:0:15140:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787787451.453651:0:15140:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9d07055ed000 00000020:01000004:3.0:1787787451.453665:0:15140:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787787451.453676:0:15140:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787787451.453689:0:15140:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9d073ca00000) 00000020:00000080:3.0:1787787451.453705:0:15140:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787787451.470945:0:15140:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787787451.471434:0:15140:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787787451.472768:0:15140:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787787451.473136:0:15140:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787787451.473362:0:15140:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787787451.474094:0:15140:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 425: rc = 0 00100000:10000000:2.0:1787787451.474197:0:15140:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 425: rc = 0 00100000:10000000:2.0:1787787451.474302:0:15140:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 425: rc = 0 00100000:10000000:2.0:1787787451.474980:0:15140:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 368: rc = 0 00100000:10000000:2.0:1787787451.475329:0:15140:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 368: rc = 0 00100000:10000000:2.0:1787787451.475785:0:15140:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 368: rc = 0 00100000:10000000:2.0:1787787451.476044:0:15140:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 368: rc = 0 00100000:10000000:2.0:1787787451.476286:0:15140:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 368: rc = 0 00100000:10000000:2.0:1787787451.476783:0:15140:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 368: rc = 0 00000020:00000080:2.0:1787787451.477844:0:15140:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787787451.477856:0:15140:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787787451.477867:0:15140:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdeb1953cba4b21b7 00000020:01000004:2.0:1787787451.477875:0:15140:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787787451.477895:0:15140:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.110@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787787451.477899:0:15140:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.110@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787787451.477904:0:15140:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787787451.477908:0:15140:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787787451.477918:0:15140:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9d07031299b8) 00000020:00000080:2.0:1787787451.477930:0:15140:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1787787451.479092:0:15140:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787787451.479264:0:15140:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787787451.479270:0:15140:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787787451.487015:0:15140:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787787451.487047:0:15140:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787787451.487467:0:15140:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787787451.487474:0:15140:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787787451.489269:0:15140:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787787451.489423:0:15140:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787787451.489428:0:15140:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787787451.490013:0:15140:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787787451.490019:0:15140:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787787451.506812:0:15140:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787787451.507147:0:15140:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787787451.507155:0:15140:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787787451.509121:0:15140:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787787451.509139:0:15140:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787787451.510157:0:15140:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787787451.510169:0:15140:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787787451.513234:0:15140:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787787451.513421:0:15140:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787787451.513427:0:15140:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787787451.515548:0:15140:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787787451.515559:0:15140:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787787451.565250:0:15140:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787787451.565545:0:15140:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787787451.565553:0:15140:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787787451.566425:0:15140:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787787451.566434:0:15140:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787787451.567010:0:15140:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787787451.567043:0:15140:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787787451.567049:0:15140:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.110@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787787451.576163:0:15140:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.110@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787787451.576265:0:15140:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.110@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787787451.576269:0:15140:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787787451.576271:0:15140:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787787451.576273:0:15140:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787787451.576274:0:15140:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787787451.576276:0:15140:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787787451.576277:0:15140:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787787451.576279:0:15140:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787787451.576281:0:15140:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787787451.576282:0:15140:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787787451.576285:0:15140:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787787451.576288:0:15140:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787787451.576289:0:15140:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787787451.576290:0:15140:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787787451.576292:0:15140:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787787451.576293:0:15140:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787787451.576294:0:15140:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787787451.576295:0:15140:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787787451.576296:0:15140:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787787451.576297:0:15140:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787787451.576321:0:15140:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787787451.576339:0:15140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1ded00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694494080:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787787451.576413:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787451.580965:0:15140:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0707a786c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787451.581261:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694494080 00000100:00100000:0.0:1787787451.581270:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694494080 00000100:00100000:0.0:1787787451.581363:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787787451.581373:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072d8cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+12:15140:x1874630694494080:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787787451.581431:0:14455:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787787451.581434:0:14455:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787787451.581469:0:14455:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787787451.601061:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072d8cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+12:15140:x1874630694494080:12345-0@lo:253:mount.lustre.0 Request processed in 19680us (24638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787451.601075:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787787451.601199:0:15140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1ded00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694494080:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787787451.601214:0:15140:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787787451.601217:0:15140:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787787451.601218:0:15140:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787787451.601220:0:15140:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787787451.601221:0:15140:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787787451.601223:0:15140:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787787451.601236:0:15140:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787787451.601237:0:15140:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787787451.601239:0:15140:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787787451.601240:0:15140:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787787451.601259:0:15140:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d07055ed000 from lustre-OST0000 10000000:01000000:2.0:1787787451.601283:0:15140:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787787451.601286:0:15140:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787787451.601292:0:15140:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d07092d8000 local copy 00010000:00010000:2.0:1787787451.601301:0:15140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d07059fd600/0xdeb1953cba4b20ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b20b4 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787451.601679:0:15140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1ded00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694494208:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787787451.601718:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787451.601796:0:15140:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0707a78c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787787451.603415:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694494208 00000100:00100000:3.0:1787787451.603429:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694494208 00000100:00100000:3.0:1787787451.603641:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787787451.603654:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072d8cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+12:15140:x1874630694494208:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787451.603940:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072d8cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+12:15140:x1874630694494208:12345-0@lo:501:mount.lustre.0 Request processed in 290us (2220us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787787451.603947:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787787451.604070:0:15140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1ded00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694494208:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787787451.604091:0:15140:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.110@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787787451.604243:0:15140:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.110@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787787451.604252:0:15140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d07059fd600/0xdeb1953cba4b20ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b20b4 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787451.604263:0:15140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d07059fd600/0xdeb1953cba4b20ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b20b4 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787451.604285:0:15140:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d07055ed000 10000000:01000000:2.0:1787787451.604290:0:15140:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787787451.604294:0:15140:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9d07092d8000 10000000:01000000:2.0:1787787451.604297:0:15140:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787787451.604300:0:15140:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9d07092d8000 from 1 10000000:01000000:2.0:1787787451.604303:0:15140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787787451.604330:0:15140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d073fd38a00/0xdeb1953cba4b21c5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787451.604344:0:15140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d073fd38a00/0xdeb1953cba4b21c5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787451.604353:0:15140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d073fd38a00/0xdeb1953cba4b21c5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787451.604371:0:15140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1ded00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694494336:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787787451.604406:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787451.607790:0:15140:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0707a78c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787787451.613312:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694494336 00000100:00100000:1.0:1787787451.613327:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694494336 00000100:00100000:1.0:1787787451.613387:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787787451.613396:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072d8cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+12:15140:x1874630694494336:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787787451.613412:0:14454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787451.613430:0:14454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0737a1c000/0xdeb1953cba4b21cc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b21c5 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787451.613476:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0737a1c000/0xdeb1953cba4b21cc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b21c5 expref: 13 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787451.613488:0:14454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0737a1c000/0xdeb1953cba4b21cc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b21c5 expref: 13 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787451.613499:0:14454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1c000, rc 0) 00000100:00100000:1.0:1787787451.614736:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072d8cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+13:15140:x1874630694494336:12345-0@lo:101:mount.lustre.0 Request processed in 1332us (10321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787451.614747:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787787451.614890:0:15140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1ded00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694494336:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787787451.614913:0:15140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d073fd38a00/0xdeb1953cba4b21c5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b21cc expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787451.614925:0:15140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d073fd38a00/0xdeb1953cba4b21c5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b21cc expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787451.614945:0:15140:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787787451.614959:0:15140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d073fd38a00/0xdeb1953cba4b21c5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b21cc expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787451.614966:0:15140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d073fd38a00/0xdeb1953cba4b21c5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b21cc expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787451.614973:0:15140:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787787451.614978:0:15140:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787787451.614983:0:15140:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787787451.614986:0:15140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787787451.615037:0:15140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d073fd39c00/0xdeb1953cba4b21d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787451.615045:0:15140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d073fd39c00/0xdeb1953cba4b21d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787451.615053:0:15140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d073fd39c00/0xdeb1953cba4b21d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787451.615073:0:15140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1ded00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694494464:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787787451.615108:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787451.615142:0:15140:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0707a78c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787787451.615433:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694494464 00000100:00100000:3.0:1787787451.615483:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694494464 00000100:00100000:3.0:1787787451.615541:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787787451.615565:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072d8cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+13:15140:x1874630694494464:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787787451.615586:0:14453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787451.615605:0:14453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0708771800/0xdeb1953cba4b21da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b21d3 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787451.615637:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0708771800/0xdeb1953cba4b21da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b21d3 expref: 14 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787451.615649:0:14453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0708771800/0xdeb1953cba4b21da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b21d3 expref: 14 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787451.615659:0:14453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708771800, rc 0) 00000100:00100000:3.0:1787787451.615742:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072d8cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+14:15140:x1874630694494464:12345-0@lo:101:mount.lustre.0 Request processed in 180us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787451.615749:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787787451.616212:0:15140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1ded00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694494464:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787787451.616232:0:15140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d073fd39c00/0xdeb1953cba4b21d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b21da expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787451.616242:0:15140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d073fd39c00/0xdeb1953cba4b21d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b21da expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787787451.617301:0:15140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787787451.619850:0:15140:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787787451.620169:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787787451.621954:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787787451.622018:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787787451.622122:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787787451.622197:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787787451.622246:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787787451.622356:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787787451.622364:0:15140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787787451.622510:0:15140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0705976940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694494592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787451.622582:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787451.622647:0:15140:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073c834900 going to sleep for 11 seconds 00000100:00100000:0.0:1787787451.622735:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694494592 00000100:00100000:0.0:1787787451.622743:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694494592 00000100:00100000:0.0:1787787451.622789:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787787451.622799:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072d8ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+14:15140:x1874630694494592:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787787451.623153:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072d8ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+14:15140:x1874630694494592:12345-0@lo:501:mount.lustre.0 Request processed in 354us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787451.623161:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787787451.623581:0:15140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0705976940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694494592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787451.623636:0:15140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0705976940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694494720:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787787451.623699:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787451.623738:0:15140:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073c834900 going to sleep for 11 seconds 00000100:00100000:1.0:1787787451.623795:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694494720 00000100:00100000:1.0:1787787451.623810:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694494720 00000100:00100000:1.0:1787787451.623935:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787787451.623947:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072d8cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+14:15140:x1874630694494720:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787787451.624481:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072d8cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+14:15140:x1874630694494720:12345-0@lo:503:mount.lustre.0 Request processed in 535us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787451.624500:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787787451.624720:0:15140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0705976940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694494720:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787787451.628388:0:15140:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787787451.628528:0:15140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0705976940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694494848:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787787451.628611:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787451.628650:0:15140:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073c834900 going to sleep for 11 seconds 00000100:00100000:0.0:1787787451.628821:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694494848 00000100:00100000:0.0:1787787451.628829:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694494848 00000100:00100000:0.0:1787787451.628878:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787787451.628887:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072d8cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+14:15140:x1874630694494848:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787787451.629159:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072d8cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+14:15140:x1874630694494848:12345-0@lo:502:mount.lustre.0 Request processed in 272us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787451.629246:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787787451.630049:0:15140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0705976940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694494848:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787787451.630847:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787787451.632360:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787787451.632402:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787787451.632496:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787787451.633022:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787787451.633080:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787787451.633132:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787787451.633166:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787787451.633196:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1787787451.633992:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1787787451.634061:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1787787451.634123:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1787787451.634174:0:15140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0705976940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694494976:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787787451.634338:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787451.634393:0:15140:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073c834900 going to sleep for 11 seconds 00000100:00100000:0.0:1787787451.635340:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694494976 00000100:00100000:0.0:1787787451.635352:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694494976 00000100:00100000:0.0:1787787451.635415:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787787451.635425:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072d8ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+14:15140:x1874630694494976:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787787451.635718:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072d8ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+14:15140:x1874630694494976:12345-0@lo:502:mount.lustre.0 Request processed in 294us (1380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787451.635727:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787787451.636116:0:15140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0705976940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694494976:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787787451.636237:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1787787451.636250:0:15140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1787787451.637389:0:15154:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787787451.637405:0:15154:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787787451.637411:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787451.637414:0:15154:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787787451.637420:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787787451.637582:0:15154:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9d073ca019b8) 00000020:00000080:3.0:1787787451.637607:0:15154:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787787451.637613:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787787451.637831:0:15154:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d07055ed000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787787451.637841:0:15154:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787787451.637848:0:15154:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdeb1953cba4b21e8 00010000:00010000:3.0:1787787451.646241:0:15154:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1787787451.646894:0:15154:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:3.0:1787787451.649308:0:15154:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1787787451.652619:0:15154:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787787451.652630:0:15154:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787787451.652635:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787451.652638:0:15154:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787787451.652641:0:15154:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787787451.652643:0:15154:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1787787451.652645:0:15154:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787787451.652647:0:15154:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787787451.652648:0:15154:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787787451.652650:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787451.652657:0:15154:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787787451.652661:0:15154:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787787451.652664:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787451.652665:0:15154:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787787451.652668:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787787451.652670:0:15154:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787787451.652672:0:15154:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787787451.652675:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787451.652676:0:15154:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787787451.652679:0:15154:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787787451.652681:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787451.652682:0:15154:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787787451.652686:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787787451.652755:0:15154:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787787451.652759:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787451.652761:0:15154:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787787451.652764:0:15154:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1787787451.653047:0:15140:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1787787451.653079:0:15140:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787787451.653103:0:15140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d073fd39c00/0xdeb1953cba4b21d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b21da expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787451.653115:0:15140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d073fd39c00/0xdeb1953cba4b21d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b21da expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787451.653123:0:15140:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d07055ed000 from 1 10000000:01000000:3.0:1787787451.653127:0:15140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787787451.653166:0:15140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0708771a00/0xdeb1953cba4b21ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787451.653174:0:15140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d0708771a00/0xdeb1953cba4b21ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787451.653184:0:15140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d0708771a00/0xdeb1953cba4b21ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787451.653223:0:15140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0705976940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694495104:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787787451.653298:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787451.653414:0:15140:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073c834b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787787451.653598:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694495104 00000100:00100000:1.0:1787787451.653605:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694495104 00000100:00100000:1.0:1787787451.653654:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787787451.653664:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072d8cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+14:15140:x1874630694495104:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787787451.653687:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787451.653699:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0737a1d800/0xdeb1953cba4b21f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b21ef expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787451.653722:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0737a1d800/0xdeb1953cba4b21f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b21ef expref: 15 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787451.653733:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0737a1d800/0xdeb1953cba4b21f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b21ef expref: 15 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787451.653752:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1d800, rc 0) 00000100:00100000:1.0:1787787451.653795:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072d8cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+15:15140:x1874630694495104:12345-0@lo:101:mount.lustre.0 Request processed in 132us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787451.653802:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787787451.655126:0:15140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0705976940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694495104:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787787451.655151:0:15140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d0708771a00/0xdeb1953cba4b21ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b21f6 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787451.655164:0:15140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d0708771a00/0xdeb1953cba4b21ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b21f6 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787787451.655898:0:15140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787787451.656563:0:15140:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787787451.656945:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787787451.656991:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787787451.657066:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787787451.657075:0:15140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787787451.657137:0:15140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1ded00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694495232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787787451.657194:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787451.657233:0:15140:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0707a783c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787451.657384:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694495232 00000100:00100000:1.0:1787787451.657391:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694495232 00000100:00100000:1.0:1787787451.657434:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787787451.657456:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072d8cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+15:15140:x1874630694495232:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787451.657674:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072d8cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+15:15140:x1874630694495232:12345-0@lo:501:mount.lustre.0 Request processed in 218us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787451.657683:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787787451.657941:0:15140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1ded00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694495232:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787451.657976:0:15140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0705977840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694495360:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787787451.658015:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787451.658057:0:15140:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073c834780 going to sleep for 11 seconds 00000100:00100000:2.0:1787787451.658112:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694495360 00000100:00100000:2.0:1787787451.658117:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694495360 00000100:00100000:2.0:1787787451.658150:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787787451.658157:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+15:15140:x1874630694495360:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787787451.658288:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+15:15140:x1874630694495360:12345-0@lo:503:mount.lustre.0 Request processed in 130us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787451.658294:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787787451.659020:0:15140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0705977840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694495360:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787787451.659659:0:15140:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787787451.659879:0:15140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0705977840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694495488:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787787451.659936:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787451.659977:0:15140:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073c834780 going to sleep for 11 seconds 00000100:00100000:1.0:1787787451.660185:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694495488 00000100:00100000:1.0:1787787451.660191:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694495488 00000100:00100000:1.0:1787787451.660233:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787787451.660242:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+15:15140:x1874630694495488:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787787451.660423:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+15:15140:x1874630694495488:12345-0@lo:502:mount.lustre.0 Request processed in 181us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787451.660468:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787787451.660640:0:15140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0705977840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694495488:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787787451.663326:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787787451.663417:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787787451.663614:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787787451.663654:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787787451.663690:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787787451.663909:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787787451.663954:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787787451.663987:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787787451.664046:0:15140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694495616:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787787451.664120:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787451.664218:0:15140:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0601aad480 going to sleep for 11 seconds 00000100:00100000:3.0:1787787451.664305:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694495616 00000100:00100000:3.0:1787787451.664312:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694495616 00000100:00100000:3.0:1787787451.664395:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787787451.664405:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+15:15140:x1874630694495616:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787787451.664641:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+15:15140:x1874630694495616:12345-0@lo:502:mount.lustre.0 Request processed in 237us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787451.664650:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787787451.664752:0:15140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694495616:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787787451.664876:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787787451.664895:0:15140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1787787451.672876:0:15158:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787451.672888:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787451.672890:0:15158:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787787451.672897:0:15158:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d07055ed000 00000020:00000080:0.0:1787787451.672900:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787787451.672906:0:15158:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787451.672908:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787451.672909:0:15158:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787787451.672911:0:15158:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787451.672913:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787451.672915:0:15158:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787787451.672917:0:15158:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d07055ed000 00000020:00000080:0.0:1787787451.672919:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787787451.672975:0:15158:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787451.672978:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787451.672979:0:15158:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787787451.672982:0:15158:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787451.672984:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787451.672985:0:15158:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787787451.672988:0:15158:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d07055ed000 00000020:00000080:0.0:1787787451.672989:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787787451.673020:0:15158:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787451.673023:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787451.673025:0:15158:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787787451.673039:0:15158:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1787787451.681781:0:15140:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787787451.681830:0:15140:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787787451.681857:0:15140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0708771a00/0xdeb1953cba4b21ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b21f6 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787451.681871:0:15140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d0708771a00/0xdeb1953cba4b21ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b21f6 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787451.681921:0:15140:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787787451.681925:0:15140:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d07055ed000 10000000:01000000:1.0:1787787451.681927:0:15140:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d07055ed000 10000000:01000000:1.0:1787787451.681931:0:15140:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787787451.681937:0:15140:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d07055ed000 from 1 10000000:01000000:1.0:1787787451.681940:0:15140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787787451.681974:0:15140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0737a1cc00/0xdeb1953cba4b21fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787451.681983:0:15140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d0737a1cc00/0xdeb1953cba4b21fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787451.682002:0:15140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d0737a1cc00/0xdeb1953cba4b21fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787451.682039:0:15140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a092c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694495744:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787787451.682106:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787451.682139:0:15140:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0601aad480 going to sleep for 11 seconds 00000100:00100000:3.0:1787787451.682271:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694495744 00000100:00100000:3.0:1787787451.682278:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694495744 00000100:00100000:3.0:1787787451.682324:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787787451.682333:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+15:15140:x1874630694495744:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787787451.682353:0:14454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787451.682365:0:14454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0708771400/0xdeb1953cba4b2204 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b21fd expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787451.682387:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0708771400/0xdeb1953cba4b2204 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b21fd expref: 16 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787451.682398:0:14454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0708771400/0xdeb1953cba4b2204 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b21fd expref: 16 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787451.682406:0:14454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708771400, rc 0) 00000100:00100000:3.0:1787787451.682476:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+16:15140:x1874630694495744:12345-0@lo:101:mount.lustre.0 Request processed in 144us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787451.682483:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787787451.682732:0:15140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a092c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694495744:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787787451.682759:0:15140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d0737a1cc00/0xdeb1953cba4b21fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b2204 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787451.682769:0:15140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d0737a1cc00/0xdeb1953cba4b21fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b2204 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787787451.684918:0:15140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1787787451.685401:0:15140:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787787451.687210:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787787451.687268:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787787451.687304:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787787451.687364:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787787451.687406:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787787451.689339:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787787451.689419:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787787451.689485:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787787451.689893:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787787451.689937:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787787451.689973:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787787451.690021:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787787451.690078:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787787451.690115:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787787451.690196:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787787451.690234:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787787451.690269:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787787451.690332:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787787451.690375:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787787451.690409:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787787451.690496:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787787451.690550:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787787451.690585:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787787451.690634:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787787451.690672:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787787451.690708:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787787451.690775:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787787451.692375:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787787451.693331:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787787451.693345:0:15140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1787787451.693466:0:15140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a092c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694495872:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787451.693542:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787451.693596:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694495872 00000100:00100000:1.0:1787787451.693602:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694495872 00000100:00100000:1.0:1787787451.693643:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787787451.693652:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+16:15140:x1874630694495872:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787451.693888:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+16:15140:x1874630694495872:12345-0@lo:501:mount.lustre.0 Request processed in 237us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787451.693896:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787787451.693938:0:15140:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0601aad480 going to sleep for 11 seconds 00000100:00100000:1.0:1787787451.693959:0:15140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a092c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694495872:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787451.693990:0:15140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a092c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694496000:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787787451.694025:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787451.696242:0:15140:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0601aad480 going to sleep for 11 seconds 00000100:00100000:3.0:1787787451.696256:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694496000 00000100:00100000:3.0:1787787451.696265:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694496000 00000100:00100000:1.0:1787787451.696878:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787787451.696893:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+16:15140:x1874630694496000:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787787451.697132:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+16:15140:x1874630694496000:12345-0@lo:503:mount.lustre.0 Request processed in 244us (3106us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787451.697141:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787787451.697266:0:15140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a092c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694496000:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787787451.698683:0:15140:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787787451.698873:0:15140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694496128:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787787451.698934:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787451.699013:0:15140:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0708ad8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787787451.699058:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694496128 00000100:00100000:1.0:1787787451.699064:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694496128 00000100:00100000:1.0:1787787451.699144:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787787451.699153:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+16:15140:x1874630694496128:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787787451.699347:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+16:15140:x1874630694496128:12345-0@lo:502:mount.lustre.0 Request processed in 195us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787451.699354:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787787451.699428:0:15140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694496128:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787787451.700260:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787787451.700322:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787787451.700362:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787787451.700584:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787787451.700654:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787787451.700863:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787787451.700939:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787787451.701003:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787787451.701081:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787787451.701116:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787787451.701148:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787787451.701191:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787787451.701226:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787787451.701276:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787787451.701325:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787787451.701362:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787787451.701398:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787787451.701596:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787787451.701638:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787787451.701674:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787787451.701723:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787787451.701896:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787787451.701934:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787787451.701980:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787787451.702018:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1787787451.702069:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1787787451.702157:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1787787451.702230:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1787787451.702302:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1787787451.702388:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1787787451.702458:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1787787451.702648:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1787787451.702702:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1787787451.702927:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1787787451.702979:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1787787451.703063:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1787787451.703110:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1787787451.703158:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1787787451.703220:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1787787451.703263:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1787787451.703311:0:15140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694496256:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787787451.703394:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787451.703599:0:15140:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0708ad8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787787451.705692:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694496256 00000100:00100000:1.0:1787787451.705706:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694496256 00000100:00100000:1.0:1787787451.705948:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787787451.705963:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+16:15140:x1874630694496256:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787787451.706284:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+16:15140:x1874630694496256:12345-0@lo:502:mount.lustre.0 Request processed in 325us (2889us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787451.706293:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787787451.706673:0:15140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694496256:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787787451.706820:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1787787451.706842:0:15140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787787451.711153:0:15163:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787787451.711190:0:15163:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9d0715c70000) 00000020:00000080:1.0:1787787451.711216:0:15163:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1787787451.711304:0:15163:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d07055ed000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787787451.711308:0:15163:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d07055ed000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787787451.711311:0:15163:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d07055ed000 3 00010000:00080000:1.0:1787787451.711342:0:15163:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d073c777800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.110@tcp at head 00010000:00010000:1.0:1787787451.714197:0:15163:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1787787451.714522:0:15163:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787787451.714560:0:15163:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787787451.714573:0:15163:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xdeb1953cba4b2212 00000100:00080000:1.0:1787787451.714584:0:15163:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787787451.714589:0:15163:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d073c777800 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:1.0:1787787451.714625:0:15163:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0707a09e00 x1874630694496384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787787451.714671:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3290:1874630694496384:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787787451.714820:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787451.714872:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694496384 00000100:00100000:0.0:1787787451.714879:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694496384 00000100:00100000:0.0:1787787451.714911:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787787451.714918:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3290:x1874630694496384:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787787451.714951:0:14460:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 363 last 0 00000020:00000080:0.0:1787787451.714981:0:14460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xdeb1953cba4b2219 00000004:00100000:0.0:1787787451.714995:0:14460:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787787451.715025:0:14460:0:(import.c:65:import_set_state_nolock()) ffff9d07092ee800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1787787451.715098:0:15163:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787787451.715121:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787787451.715126:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787787451.715128:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787787451.715131:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787787451.715174:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874630694496512:0@lo:400:kworker.0 00000100:00100000:1.0:1787787451.715206:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787451.715256:0:14462:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787787451.715264:0:14462:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000040:00080000:1.0:1787787451.715873:0:15163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:1.0:1787787451.716673:0:14461:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787787451.716687:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694496512 00000100:00100000:1.0:1787787451.716695:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694496512 00000100:00100000:1.0:1787787451.716725:0:14461:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787787451.716800:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787787451.716866:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1874630694496512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787451.717000:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1874630694496512:12345-0@lo:400:kworker.0 Request processed in 139us (1792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787451.717008:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787787451.717114:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d0707a0b0c0 x1874630694496512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787451.717129:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874630694496512:0@lo:400:kworker.0 00000100:00100000:0.0:1787787451.717901:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1874630694496384:12345-0@lo:38:llog_process_th.0 Request processed in 2977us (3077us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787451.717912:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:0.0:1787787451.717953:0:15140:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787787451.717983:0:15140:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787787451.717996:0:15140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0737a1cc00/0xdeb1953cba4b21fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b2204 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787451.718007:0:15140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d0737a1cc00/0xdeb1953cba4b21fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b2204 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787787451.718065:0:15140:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787787451.718067:0:15140:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787787451.718069:0:15140:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787451.718070:0:15140:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787787451.718071:0:15140:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787451.718072:0:15140:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787451.718073:0:15140:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787787451.718075:0:15140:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787451.718076:0:15140:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787787451.718080:0:15140:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787787451.718082:0:15140:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787787451.718084:0:15140:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787787451.718085:0:15140:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787451.718086:0:15140:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787787451.718087:0:15140:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787451.718088:0:15140:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787451.718089:0:15140:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787787451.718090:0:15140:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787451.718096:0:15140:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787787451.718119:0:15140:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00010000:00080000:3.0:1787787451.718131:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d0707a09e00 x1874630694496384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787787461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787451.718140:0:15140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e483c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694496640:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787787451.718144:0:3290:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787787451.718152:0:3290:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1787787451.718159:0:3290:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787787451.718164:0:3290:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787787451.718167:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9d073c777800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787787451.718174:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3290:1874630694496384:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787787451.718195:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787451.718225:0:15140:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070693e240 going to sleep for 11 seconds 00000100:00100000:1.0:1787787451.718698:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694496640 00000100:00100000:1.0:1787787451.718704:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694496640 00000100:00100000:1.0:1787787451.718802:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787787451.718812:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+16:15140:x1874630694496640:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787787451.718836:0:14454:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787787451.718849:0:14454:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787787451.759056:0:14454:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787787451.759080:0:14454:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787787451.759138:0:14476:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787787451.759144:0:14476:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787787451.759174:0:14476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d073fd39e00/0xdeb1953cba4b2220 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787451.759195:0:14476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b218d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b2186 expref: 16 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787451.759204:0:14476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d073fd39e00/0xdeb1953cba4b2220 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787451.759250:0:14476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b218d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b2186 expref: 16 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787451.759266:0:14476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b218d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b2186 expref: 16 pid: 14455 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787451.759281:0:14476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1df480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14476:1874630694496768:0@lo:104: 00000100:00100000:2.0:1787787451.759350:0:14476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787451.759400:0:14476:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0708ad83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787451.759455:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694496768 00000100:00100000:2.0:1787787451.759461:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694496768 00000100:00100000:2.0:1787787451.759516:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787787451.759524:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1df840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+3:14476:x1874630694496768:12345-0@lo:104: 00010000:00010000:2.0:1787787451.759536:0:14445:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9d073fd39000/0xdeb1953cba4b2186 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b218d expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787451.759597:0:14445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787787451.759622:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1df840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+3:14476:x1874630694496768:12345-0@lo:104: Request processed in 96us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787451.759629:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1787787451.759648:0:14450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787451.759653:0:14450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d073fd39000/0xdeb1953cba4b2186 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b218d expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787451.759660:0:14450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39000 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:2.0:1787787451.759664:0:14450:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d073fd39000/0xdeb1953cba4b2186 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b218d expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787451.759676:0:14450:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d073fd39000/0xdeb1953cba4b2186 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b218d expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787451.759693:0:14450:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d073fd39000/0xdeb1953cba4b2186 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b218d expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787451.759700:0:14450:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1787787451.759714:0:14476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1df480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14476:1874630694496768:0@lo:104: 00010000:00010000:2.0:1787787451.759733:0:14450:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d073fd39000/0xdeb1953cba4b2186 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b218d expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787451.759743:0:14476:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d073fd39e00/0xdeb1953cba4b2220 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787451.759809:0:14450:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787451.759838:0:14450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d073fd39000/0xdeb1953cba4b2186 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b218d expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787451.759845:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d073fd39000/0xdeb1953cba4b2186 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b218d expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787451.759862:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:3293:1874630694496896:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787787451.759863:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787451.759866:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787451.759870:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787451.759901:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787451.759952:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694496896 00000100:00100000:3.0:1787787451.759957:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694496896 00010000:00010000:3.0:1787787451.759974:0:14446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b218d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b2186 expref: 17 pid: 14455 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787451.760002:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787787451.760009:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705977840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+17:3293:x1874630694496896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787787451.760024:0:14446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787451.760040:0:14446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b218d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b2186 expref: 17 pid: 14455 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787451.760050:0:14446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b218d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b2186 expref: 17 pid: 14455 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787451.760063:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b218d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b2186 expref: 17 pid: 14455 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787451.760081:0:14446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d073fd39e00/0xdeb1953cba4b2220 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787451.760089:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d073fd39e00/0xdeb1953cba4b2220 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787787451.760108:0:14446:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014415966s 00010000:00010000:3.0:1787787451.760113:0:14446:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d073fd39e00/0xdeb1953cba4b2220 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787451.760120:0:14446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d073fd39e00/0xdeb1953cba4b2220 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787451.760127:0:14446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d073fd39e00/0xdeb1953cba4b2220 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787451.760133:0:14446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d073fd39e00/0xdeb1953cba4b2220 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787451.760138:0:14446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39e00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787451.760142:0:14446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d073fd39e00/0xdeb1953cba4b2220 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787451.760150:0:14446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d073fd39e00/0xdeb1953cba4b2220 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787451.760170:0:14446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d073fd39e00/0xdeb1953cba4b2220 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787451.760179:0:14446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787451.760210:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705977840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+16:3293:x1874630694496896:12345-0@lo:103:ldlm_bl.0 Request processed in 202us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787451.760217:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787787451.760246:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:3293:1874630694496896:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787787451.760496:0:14476:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d073fd39e00/0xdeb1953cba4b2220 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787451.761854:0:14476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d073fd39e00/0xdeb1953cba4b2220 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787451.761861:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d073fd39e00/0xdeb1953cba4b2220 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787451.772876:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+15:15140:x1874630694496640:12345-0@lo:253:mount.lustre.0 Request processed in 54055us (54671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787451.772904:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787787451.773035:0:15140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e483c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15140:1874630694496640:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787787451.773052:0:15140:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787787451.773056:0:15140:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787787451.773057:0:15140:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787787451.773059:0:15140:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787451.773060:0:15140:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787787451.773061:0:15140:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787451.773062:0:15140:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787451.773063:0:15140:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787787451.773065:0:15140:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787451.773067:0:15140:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787787451.773082:0:15140:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787787451.780682:0:15140:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787787451.780935:0:15140:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787787451.781348:0:15140:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787787451.782084:0:15140:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787787451.782884:0:15140:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787787451.783573:0:15140:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787787451.785015:0:15140:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787787451.832138:0:15140:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787787451.832147:0:15140:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787787451.832184:0:15140:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787787451.832239:0:15140:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.110@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787787451.832252:0:15140:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787787451.832281:0:15140:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787787451.969131:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787453.000475:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787787453.253254:0:14492:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1787787453.699695:0:14458:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787787453.699701:0:14458:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d0706340800 from 7 10000000:01000000:3.0:1787787453.699706:0:14458:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787787453.699750:0:14458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0708770600/0xdeb1953cba4b2227 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787453.699762:0:14458:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d0708770600/0xdeb1953cba4b2227 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787453.699774:0:14458:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d0708770600/0xdeb1953cba4b2227 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787453.699798:0:14458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0705977c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694497024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787787453.699861:0:14458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787453.699915:0:14458:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071844be40 going to sleep for 11 seconds 00000100:00100000:1.0:1787787453.700026:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694497024 00000100:00100000:1.0:1787787453.700034:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694497024 00000100:00100000:1.0:1787787453.700091:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787787453.700100:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073ff7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+15:14458:x1874630694497024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787453.700115:0:14453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787453.700128:0:14453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0737a1d000/0xdeb1953cba4b222e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b2227 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787453.700150:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0737a1d000/0xdeb1953cba4b222e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b2227 expref: 16 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787453.700161:0:14453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0737a1d000/0xdeb1953cba4b222e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b2227 expref: 16 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787453.700183:0:14453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1d000, rc 0) 00000100:00100000:1.0:1787787453.700231:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073ff7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+16:14458:x1874630694497024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787453.700238:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787787453.700330:0:14458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0705977c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694497024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787453.700344:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d0708770600/0xdeb1953cba4b2227 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b222e expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787453.700353:0:14458:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d0708770600/0xdeb1953cba4b2227 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b222e expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787453.700401:0:14458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694497152:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787787453.700465:0:14458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787453.700488:0:14458:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d072b1b6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787787453.700593:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694497152 00000100:00100000:1.0:1787787453.700598:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694497152 00000100:00100000:1.0:1787787453.700626:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787787453.700633:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073ff7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+16:14458:x1874630694497152:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787787453.700645:0:14454:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787787453.700660:0:14454:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787787453.700664:0:14454:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1787787453.700734:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073ff7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+16:14458:x1874630694497152:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 101us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787453.700742:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787787453.700857:0:14458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694497152:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787787453.700919:0:14458:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787787453.700925:0:14458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0708770600/0xdeb1953cba4b2227 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b222e expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787453.700934:0:14458:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d0708770600/0xdeb1953cba4b2227 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b222e expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787454.015402:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787455.036686:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787456.064552:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787787456.892593:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787787456.892598:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787787456.892601:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787787456.892603:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787787456.892641:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787787456.892675:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:3293:1874630694497280:0@lo:400:kworker.0 00000100:00100000:1.0:1787787456.892739:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787456.892790:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1874630694497408:0@lo:400:kworker.0 00000100:00100000:1.0:1787787456.892825:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787456.892844:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787787456.892848:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694497536:0@lo:400:kworker.0 00000100:00100000:1.0:1787787456.892867:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787456.892895:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694497280 00000100:00100000:1.0:1787787456.892901:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694497280 00000100:00100000:1.0:1787787456.892939:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787787456.892947:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073ff7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+16:3293:x1874630694497280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787456.892993:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073ff7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+16:3293:x1874630694497280:12345-0@lo:400:kworker.0 Request processed in 46us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787456.896931:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787787456.896990:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694497408 00000100:00100000:1.0:1787787456.897008:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694497408 00000100:00100000:1.0:1787787456.897055:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694497536 00000100:00100000:1.0:1787787456.897058:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694497536 00000100:00100000:1.0:1787787456.897084:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787787456.897093:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1874630694497408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787456.897175:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1874630694497408:12345-0@lo:400:kworker.0 Request processed in 83us (4348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787456.897183:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787787456.897194:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787787456.897200:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694497536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787456.897238:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694497536:12345-0@lo:400:kworker.0 Request processed in 38us (4369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787456.897243:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787787456.897289:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0707a083c0 x1874630694497536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787456.897318:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694497536:0@lo:400:kworker.0 00010000:00080000:1.0:1787787456.897333:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0707a0a940 x1874630694497408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787456.897341:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1874630694497408:0@lo:400:kworker.0 00000100:00100000:1.0:1787787456.897381:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:3293:1874630694497280:0@lo:400:kworker.0 00000100:00080000:2.0:1787787456.897602:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787787457.084721:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787787457.115880:0:15507:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787787458.115573:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787459.133620:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787460.157821:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787461.182246:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787787462.015634:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787787462.015642:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787787462.015646:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787787462.015648:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787787462.015702:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:3293:1874630694497664:0@lo:400:kworker.0 00000100:00100000:2.0:1787787462.015781:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787462.015829:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787787462.015835:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874630694497792:0@lo:400:kworker.0 00000100:00100000:2.0:1787787462.015860:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787462.015890:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694497920:0@lo:400:kworker.0 00000100:00100000:2.0:1787787462.015915:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787462.015964:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694497664 00000100:00100000:2.0:1787787462.015986:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694497664 00000100:00100000:2.0:1787787462.016030:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787787462.016038:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073ff7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+16:3293:x1874630694497664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787462.016086:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073ff7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+16:3293:x1874630694497664:12345-0@lo:400:kworker.0 Request processed in 48us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787462.016093:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787787462.016123:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694497792 00000100:00100000:2.0:1787787462.016127:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694497792 00000100:00100000:2.0:1787787462.016153:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694497920 00000100:00100000:2.0:1787787462.016156:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694497920 00000100:00100000:2.0:1787787462.016182:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787787462.016188:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874630694497792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787462.016219:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874630694497792:12345-0@lo:400:kworker.0 Request processed in 31us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787462.016225:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787787462.016237:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787787462.016243:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694497920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787462.016272:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694497920:12345-0@lo:400:kworker.0 Request processed in 30us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787462.016278:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787787462.016300:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787787462.016328:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d071b1dda40 x1874630694497920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787462.016342:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694497920:0@lo:400:kworker.0 00010000:00080000:2.0:1787787462.016368:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d071b1de1c0 x1874630694497792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787462.016389:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874630694497792:0@lo:400:kworker.0 00000100:00100000:2.0:1787787462.016399:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:3293:1874630694497664:0@lo:400:kworker.0 00010000:00010000:0.0:1787787462.204709:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787463.234593:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787787463.427337:0:15856:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787787463.427341:0:15856:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1787787463.427688:0:15856:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9d073c771800 00000020:01000004:1.0:1787787463.427704:0:15856:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787787463.427717:0:15856:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1787787463.427731:0:15856:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9d0715c73370) 00000020:00000080:1.0:1787787463.427748:0:15856:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787787463.445304:0:15856:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787787463.445937:0:15856:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1787787463.446848:0:15856:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787787463.447084:0:15856:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1787787463.447300:0:15856:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1787787463.448848:0:15856:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 465: rc = 0 00100000:10000000:0.0:1787787463.448999:0:15856:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 465: rc = 0 00100000:10000000:0.0:1787787463.449110:0:15856:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 465: rc = 0 00100000:10000000:0.0:1787787463.449802:0:15856:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 648: rc = 0 00100000:10000000:0.0:1787787463.450094:0:15856:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 648: rc = 0 00100000:10000000:0.0:1787787463.450342:0:15856:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 648: rc = 0 00100000:10000000:0.0:1787787463.450833:0:15856:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 648: rc = 0 00100000:10000000:0.0:1787787463.451086:0:15856:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 648: rc = 0 00100000:10000000:0.0:1787787463.452247:0:15856:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 648: rc = 0 00000020:00000080:0.0:1787787463.453032:0:15856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787787463.453044:0:15856:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787787463.453055:0:15856:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdeb1953cba4b223c 00000020:01000004:0.0:1787787463.453064:0:15856:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1787787463.453094:0:15856:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.110@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787787463.453098:0:15856:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.110@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787787463.453104:0:15856:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787787463.453123:0:15856:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1787787463.453127:0:15856:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.110@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787787463.461266:0:15856:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.110@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787787463.461302:0:15856:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.110@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1787787463.461307:0:15856:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787787463.461309:0:15856:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787787463.461310:0:15856:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787463.461311:0:15856:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787787463.461313:0:15856:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787463.461314:0:15856:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787463.461316:0:15856:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787787463.461317:0:15856:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787463.461319:0:15856:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787787463.461322:0:15856:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1787787463.461324:0:15856:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787787463.461326:0:15856:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787787463.461327:0:15856:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787463.461328:0:15856:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787787463.461329:0:15856:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787463.461330:0:15856:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787463.461331:0:15856:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787787463.461332:0:15856:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787463.461333:0:15856:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787787463.461356:0:15856:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787787463.461375:0:15856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e49a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694498048:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787787463.462042:0:15856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787463.462162:0:15856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073c8349c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787463.465085:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694498048 00000100:00100000:1.0:1787787463.465099:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694498048 00000100:00100000:1.0:1787787463.465153:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787787463.465162:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073ff7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+16:15856:x1874630694498048:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787787463.465215:0:14453:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787787463.465219:0:14453:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1787787463.465223:0:14453:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787787463.473414:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073ff7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+16:15856:x1874630694498048:12345-0@lo:253:mount.lustre.0 Request processed in 8242us (11963us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787463.473466:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787787463.473575:0:15856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e49a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694498048:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787787463.473592:0:15856:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787787463.473594:0:15856:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787787463.473596:0:15856:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787787463.473604:0:15856:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787463.473666:0:15856:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787787463.473668:0:15856:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787463.473669:0:15856:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787463.473670:0:15856:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787787463.473672:0:15856:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787463.473674:0:15856:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787787463.473694:0:15856:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d073c771800 from lustre-OST0001 10000000:01000000:0.0:1787787463.473717:0:15856:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787787463.473720:0:15856:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787787463.473728:0:15856:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d07092d8000 local copy 00010000:00010000:0.0:1787787463.473740:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d07059fd600/0xdeb1953cba4b20ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b20b4 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787463.474061:0:15856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e49a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694498176:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787787463.474102:0:15856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787463.474179:0:15856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071046c480 going to sleep for 11 seconds 00000100:00100000:2.0:1787787463.474220:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694498176 00000100:00100000:2.0:1787787463.474226:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694498176 00000100:00100000:2.0:1787787463.474305:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787787463.474314:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073ff7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+16:15856:x1874630694498176:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787787463.474574:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073ff7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+16:15856:x1874630694498176:12345-0@lo:501:mount.lustre.0 Request processed in 261us (471us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787787463.474582:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787787463.474728:0:15856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e49a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694498176:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787787463.474742:0:15856:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.110@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787787463.474898:0:15856:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.110@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787787463.474906:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d07059fd600/0xdeb1953cba4b20ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b20b4 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787463.474914:0:15856:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d07059fd600/0xdeb1953cba4b20ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b20b4 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787463.474936:0:15856:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d073c771800 10000000:01000000:0.0:1787787463.474941:0:15856:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787787463.475026:0:15856:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787787463.475030:0:15856:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787787463.475034:0:15856:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787787463.475043:0:15856:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787787463.475065:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d07059fc400/0xdeb1953cba4b2243 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787463.475073:0:15856:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d07059fc400/0xdeb1953cba4b2243 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787463.475082:0:15856:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d07059fc400/0xdeb1953cba4b2243 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787463.475096:0:15856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e49a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694498304:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787787463.475124:0:15856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787463.475195:0:15856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071046c480 going to sleep for 11 seconds 00000100:00100000:2.0:1787787463.475234:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694498304 00000100:00100000:2.0:1787787463.475239:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694498304 00000100:00100000:2.0:1787787463.475269:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787787463.475275:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073ff7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+16:15856:x1874630694498304:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787787463.475284:0:14454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787463.475295:0:14454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d073fd38800/0xdeb1953cba4b224a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b2243 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787463.475315:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d073fd38800/0xdeb1953cba4b224a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b2243 expref: 17 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787463.475325:0:14454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d073fd38800/0xdeb1953cba4b224a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b2243 expref: 17 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787463.475334:0:14454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd38800, rc 0) 00000100:00100000:2.0:1787787463.475367:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073ff7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+17:15856:x1874630694498304:12345-0@lo:101:mount.lustre.0 Request processed in 92us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787463.475384:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787787463.475517:0:15856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e49a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694498304:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787787463.475530:0:15856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d07059fc400/0xdeb1953cba4b2243 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b224a expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787463.475539:0:15856:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d07059fc400/0xdeb1953cba4b2243 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b224a expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787787463.476193:0:15856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787787463.477200:0:15856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787787463.477423:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1787787463.477556:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1787787463.477592:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1787787463.477719:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1787787463.477759:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1787787463.477793:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787787463.477856:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787787463.477864:0:15856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787787463.477940:0:15856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e49a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694498432:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787787463.478081:0:15856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787463.478123:0:15856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071046c540 going to sleep for 11 seconds 00000100:00100000:3.0:1787787463.478190:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694498432 00000100:00100000:3.0:1787787463.478196:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694498432 00000100:00100000:3.0:1787787463.478238:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787787463.478248:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073ff7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+17:15856:x1874630694498432:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787463.478559:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073ff7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+17:15856:x1874630694498432:12345-0@lo:501:mount.lustre.0 Request processed in 312us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787463.478567:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787787463.478833:0:15856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e49a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694498432:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787787463.478866:0:15856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e49a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694498560:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787787463.478908:0:15856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787463.478938:0:15856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071046c540 going to sleep for 11 seconds 00000100:00100000:1.0:1787787463.479047:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694498560 00000100:00100000:1.0:1787787463.479052:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694498560 00000100:00100000:1.0:1787787463.479081:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787787463.479089:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073ff7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+17:15856:x1874630694498560:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787787463.479375:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073ff7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+17:15856:x1874630694498560:12345-0@lo:503:mount.lustre.0 Request processed in 287us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787463.479383:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787787463.479737:0:15856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e49a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694498560:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787787463.480380:0:15856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787787463.480481:0:15856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e49a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694498688:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787787463.480532:0:15856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787463.480561:0:15856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071046c540 going to sleep for 11 seconds 00000100:00100000:1.0:1787787463.480693:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694498688 00000100:00100000:1.0:1787787463.480699:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694498688 00000100:00100000:1.0:1787787463.480740:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787787463.480748:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+17:15856:x1874630694498688:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787787463.481024:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+17:15856:x1874630694498688:12345-0@lo:502:mount.lustre.0 Request processed in 277us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787463.481032:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787787463.481238:0:15856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e49a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694498688:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787787463.481589:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787787463.481717:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787787463.481770:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787787463.481824:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787787463.481862:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787787463.481892:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787787463.481935:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787787463.482060:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787787463.482127:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1787787463.482165:0:15856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0705976580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694498816:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787787463.482221:0:15856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787463.482322:0:15856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d073c5ca3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787463.482371:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694498816 00000100:00100000:2.0:1787787463.482378:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694498816 00000100:00100000:2.0:1787787463.482535:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787787463.482545:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+17:15856:x1874630694498816:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787787463.482737:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+17:15856:x1874630694498816:12345-0@lo:502:mount.lustre.0 Request processed in 193us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787463.482744:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787787463.482826:0:15856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0705976580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694498816:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787787463.482898:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1787787463.482910:0:15856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1787787463.483875:0:15857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787787463.483883:0:15857:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787787463.483889:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787463.483891:0:15857:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787787463.483898:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787787463.483912:0:15857:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9d073ca03370) 00000020:00000080:3.0:1787787463.483934:0:15857:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787787463.483939:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787787463.484075:0:15857:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d073c771800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787787463.484083:0:15857:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787787463.484100:0:15857:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdeb1953cba4b2258 00010000:00010000:3.0:1787787463.494428:0:15857:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1787787463.495029:0:15857:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00000040:00080000:1.0:1787787463.496118:0:14492:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00080000:10000000:3.0:1787787463.497507:0:15857:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1787787463.499205:0:15857:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787787463.499217:0:15857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787463.499224:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787463.499227:0:15857:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787787463.499230:0:15857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787463.499234:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787463.499236:0:15857:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787787463.499238:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787787463.499240:0:15857:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787787463.499243:0:15857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787463.499245:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787463.499246:0:15857:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787787463.499248:0:15857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787463.499250:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787463.499252:0:15857:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787787463.499255:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787787463.499308:0:15857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787463.499318:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787463.499320:0:15857:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787787463.499324:0:15857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1787787463.499505:0:15856:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1787787463.499531:0:15856:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787787463.499552:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d07059fc400/0xdeb1953cba4b2243 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b224a expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787463.499563:0:15856:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d07059fc400/0xdeb1953cba4b2243 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b224a expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787463.499571:0:15856:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d073c771800 from 1 10000000:01000000:1.0:1787787463.499574:0:15856:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787787463.499680:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0737a1dc00/0xdeb1953cba4b225f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787463.499694:0:15856:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d0737a1dc00/0xdeb1953cba4b225f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787463.499705:0:15856:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d0737a1dc00/0xdeb1953cba4b225f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787463.499727:0:15856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694498944:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787787463.499791:0:15856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787463.499904:0:15856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07059c59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787463.502313:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694498944 00000100:00100000:2.0:1787787463.502327:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694498944 00000100:00100000:2.0:1787787463.502384:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787787463.502394:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+17:15856:x1874630694498944:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787787463.502409:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787463.502425:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d073fd39800/0xdeb1953cba4b2266 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b225f expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787463.502468:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d073fd39800/0xdeb1953cba4b2266 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b225f expref: 18 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787463.502479:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d073fd39800/0xdeb1953cba4b2266 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b225f expref: 18 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787463.502487:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd39800, rc 0) 00000100:00100000:2.0:1787787463.503695:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+18:15856:x1874630694498944:12345-0@lo:101:mount.lustre.0 Request processed in 1298us (3900us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787463.503705:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787787463.503840:0:15856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694498944:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787787463.503861:0:15856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d0737a1dc00/0xdeb1953cba4b225f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b2266 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787463.503870:0:15856:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d0737a1dc00/0xdeb1953cba4b225f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b2266 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787787463.504461:0:15856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787787463.506531:0:15856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787787463.506898:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787787463.506938:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787787463.507083:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787787463.507092:0:15856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787787463.507174:0:15856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694499072:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787463.507233:0:15856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787463.507272:0:15856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07059c59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787463.507300:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694499072 00000100:00100000:1.0:1787787463.507305:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694499072 00000100:00100000:1.0:1787787463.507348:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787787463.507356:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+18:15856:x1874630694499072:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787463.507554:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+18:15856:x1874630694499072:12345-0@lo:501:mount.lustre.0 Request processed in 198us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787463.507562:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787787463.508032:0:15856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694499072:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787463.508281:0:15856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694499200:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787787463.508323:0:15856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787463.508359:0:15856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07059c59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787463.508377:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694499200 00000100:00100000:1.0:1787787463.508381:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694499200 00000100:00100000:1.0:1787787463.508405:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787787463.508411:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+18:15856:x1874630694499200:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787787463.508577:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+18:15856:x1874630694499200:12345-0@lo:503:mount.lustre.0 Request processed in 165us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787463.508584:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787787463.508642:0:15856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694499200:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787787463.509198:0:15856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787787463.509251:0:15856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694499328:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787787463.509288:0:15856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787463.509306:0:15856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07059c59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787463.509322:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694499328 00000100:00100000:1.0:1787787463.509327:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694499328 00000100:00100000:1.0:1787787463.509350:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787787463.509356:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707da8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+18:15856:x1874630694499328:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787787463.509524:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707da8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+18:15856:x1874630694499328:12345-0@lo:502:mount.lustre.0 Request processed in 167us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787463.509532:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787787463.509573:0:15856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694499328:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787787463.509910:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787787463.510046:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787787463.510099:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787787463.510135:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787787463.510169:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787787463.510218:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787787463.510251:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787787463.510281:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787787463.510309:0:15856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694499456:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787787463.510353:0:15856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787463.510381:0:15856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07059c59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787463.510712:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694499456 00000100:00100000:0.0:1787787463.510718:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694499456 00000100:00100000:0.0:1787787463.510746:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787787463.510752:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072de4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+18:15856:x1874630694499456:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787787463.510904:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072de4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+18:15856:x1874630694499456:12345-0@lo:502:mount.lustre.0 Request processed in 152us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787463.510911:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787787463.511198:0:15856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694499456:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787787463.511288:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787787463.511298:0:15856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1787787463.517332:0:15861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787787463.517354:0:15861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787463.517357:0:15861:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787787463.517366:0:15861:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d073c771800 00000020:00000080:2.0:1787787463.517370:0:15861:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787787463.517377:0:15861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787787463.517379:0:15861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787463.517381:0:15861:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787787463.517383:0:15861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787787463.517385:0:15861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787463.517386:0:15861:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787787463.517389:0:15861:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d073c771800 00000020:00000080:2.0:1787787463.517391:0:15861:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787787463.517723:0:15861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787463.518496:0:15861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787463.518500:0:15861:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787787463.518506:0:15861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787463.518510:0:15861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787463.518511:0:15861:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787787463.518515:0:15861:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d073c771800 00000020:00000080:0.0:1787787463.518517:0:15861:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787787463.518581:0:15861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787463.518585:0:15861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787463.518586:0:15861:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787787463.518589:0:15861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1787787463.518788:0:15856:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787787463.518823:0:15856:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787787463.518868:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0737a1dc00/0xdeb1953cba4b225f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b2266 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787463.518881:0:15856:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d0737a1dc00/0xdeb1953cba4b225f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b2266 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787463.518921:0:15856:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787787463.518932:0:15856:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d073c771800 10000000:01000000:1.0:1787787463.518934:0:15856:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d073c771800 10000000:01000000:1.0:1787787463.518938:0:15856:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787787463.520032:0:15856:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d073c771800 from 1 10000000:01000000:1.0:1787787463.520039:0:15856:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787787463.520072:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0737a1c800/0xdeb1953cba4b226d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787463.520083:0:15856:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d0737a1c800/0xdeb1953cba4b226d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787463.520093:0:15856:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d0737a1c800/0xdeb1953cba4b226d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787463.520114:0:15856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694499584:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787787463.520170:0:15856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787463.520207:0:15856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07059c5600 going to sleep for 11 seconds 00000100:00100000:1.0:1787787463.520496:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694499584 00000100:00100000:1.0:1787787463.520503:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694499584 00000100:00100000:1.0:1787787463.520548:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787787463.520557:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072de4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+18:15856:x1874630694499584:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787787463.520569:0:14454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787463.520581:0:14454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0737a1c600/0xdeb1953cba4b2274 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b226d expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787463.520603:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0737a1c600/0xdeb1953cba4b2274 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b226d expref: 19 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787463.520686:0:14454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0737a1c600/0xdeb1953cba4b2274 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b226d expref: 19 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787463.520706:0:14454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0737a1c600, rc 0) 00000100:00100000:1.0:1787787463.520745:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072de4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+19:15856:x1874630694499584:12345-0@lo:101:mount.lustre.0 Request processed in 189us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787463.520752:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787787463.520801:0:15856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694499584:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787787463.520816:0:15856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d0737a1c800/0xdeb1953cba4b226d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b2274 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787463.520824:0:15856:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d0737a1c800/0xdeb1953cba4b226d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b2274 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787787463.521509:0:15856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1787787463.524736:0:15856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787787463.526322:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787787463.526411:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787787463.535774:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787787463.535887:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787787463.535919:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787787463.536040:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787787463.536075:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787787463.536102:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787787463.536138:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787787463.536165:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787787463.536191:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787787463.536228:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787787463.536284:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787787463.539056:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787787463.539213:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787787463.539253:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787787463.539289:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787787463.539340:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787787463.540232:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787787463.540287:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787787463.540355:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787787463.540401:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787787463.540432:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787787463.540496:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787787463.540528:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1787787463.540558:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1787787463.540599:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1787787463.540645:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1787787463.540693:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1787787463.540738:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1787787463.540769:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1787787463.540798:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1787787463.540826:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1787787463.540865:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1787787463.540895:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1787787463.540935:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1787787463.540990:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1787787463.541079:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1787787463.541087:0:15856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1787787463.541196:0:15856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e483c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694499712:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787787463.541261:0:15856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787463.547153:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694499712 00000100:00100000:3.0:1787787463.547165:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694499712 00000100:00100000:3.0:1787787463.547231:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787787463.547242:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072de4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+19:15856:x1874630694499712:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787463.547839:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072de4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+19:15856:x1874630694499712:12345-0@lo:501:mount.lustre.0 Request processed in 597us (6576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787463.547848:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787787463.548541:0:15856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071046cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787787463.548569:0:15856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e483c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694499712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787787463.549682:0:15856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dc3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694499840:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787787463.549748:0:15856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787463.549788:0:15856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07202ee0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787463.551568:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694499840 00000100:00100000:2.0:1787787463.551582:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694499840 00000100:00100000:2.0:1787787463.551645:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787787463.551655:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072de4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+19:15856:x1874630694499840:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787787463.551871:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072de4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+19:15856:x1874630694499840:12345-0@lo:503:mount.lustre.0 Request processed in 217us (2122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787463.551879:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787787463.552513:0:15856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dc3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694499840:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787787463.553564:0:15856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787787463.553974:0:15856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dc3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694499968:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787787463.554050:0:15856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787463.554123:0:15856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07202ee0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787463.554162:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694499968 00000100:00100000:0.0:1787787463.554169:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694499968 00000100:00100000:0.0:1787787463.554243:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787787463.554253:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072de4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+19:15856:x1874630694499968:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787787463.554518:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072de4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+19:15856:x1874630694499968:12345-0@lo:502:mount.lustre.0 Request processed in 266us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787463.554526:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787787463.554755:0:15856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dc3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694499968:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787787463.555001:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787787463.555050:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787787463.555086:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787787463.555134:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787787463.555171:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787787463.555220:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787787463.555257:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787787463.555292:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787787463.555340:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787787463.555376:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787787463.555409:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787787463.555480:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787787463.555528:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787787463.555562:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787787463.555628:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787787463.555665:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787787463.555700:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787787463.555747:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787787463.555781:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787787463.555810:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787787463.555849:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787787463.555877:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787787463.555904:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787787463.555943:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787787463.555989:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787787463.556024:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787787463.556071:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787787463.556108:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787787463.556142:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787787463.556190:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787787463.556241:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787787463.556277:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787787463.556312:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787787463.556359:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787787463.556396:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787787463.556476:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787787463.556514:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787787463.556542:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787787463.556581:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787787463.556612:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787787463.556650:0:15856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694500096:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787787463.556712:0:15856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787463.557062:0:15856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07059c5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787787463.557107:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694500096 00000100:00100000:2.0:1787787463.557114:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694500096 00000100:00100000:2.0:1787787463.557150:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787787463.557158:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072de4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+19:15856:x1874630694500096:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787787463.557505:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072de4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+19:15856:x1874630694500096:12345-0@lo:502:mount.lustre.0 Request processed in 347us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787463.557513:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787787463.557670:0:15856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694500096:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787787463.557757:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787787463.557768:0:15856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1787787463.559565:0:15866:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787787463.559581:0:15866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9d0706a2b370) 00000020:00000080:2.0:1787787463.559601:0:15866:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1787787463.559692:0:15866:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d073c771800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787787463.559696:0:15866:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d073c771800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787787463.559699:0:15866:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d073c771800 3 00010000:00080000:2.0:1787787463.559726:0:15866:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d0602993800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.110@tcp at head 00010000:00010000:2.0:1787787463.561853:0:15866:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1787787463.562060:0:15866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787787463.562093:0:15866:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787787463.562104:0:15866:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xdeb1953cba4b2282 00000100:00080000:2.0:1787787463.562114:0:15866:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787787463.562120:0:15866:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d0602993800 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:2.0:1787787463.562153:0:15866:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d071b1de1c0 x1874630694500224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787787463.562215:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3290:1874630694500224:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787787463.562278:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787787463.562379:0:15866:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000040:00080000:1.0:1787787463.564059:0:15866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00080000:3.0:1787787463.566503:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787787463.566513:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787787463.566516:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787787463.566519:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787787463.566631:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694500224 00000100:00100000:3.0:1787787463.566640:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694500224 00000100:00100000:3.0:1787787463.566685:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787787463.566695:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e4a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3290:x1874630694500224:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787787463.566727:0:14461:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 375 last 0 00000020:00000080:3.0:1787787463.566771:0:14461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xdeb1953cba4b2289 00000004:00100000:3.0:1787787463.566790:0:14461:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787787463.566829:0:14461:0:(import.c:65:import_set_state_nolock()) ffff9d073f8e7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787463.568617:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0705974780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1874630694500480:0@lo:400:kworker.0 00000100:00100000:2.0:1787787463.568679:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787463.568728:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787787463.568737:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0705976580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1874630694500352:0@lo:400:kworker.0 00000100:00100000:2.0:1787787463.568760:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787463.568761:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e4a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1874630694500224:12345-0@lo:38:llog_process_th.0 Request processed in 2066us (6482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787463.568771:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787787463.568785:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694500480 00000100:00100000:3.0:1787787463.568789:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694500352 00000100:00100000:3.0:1787787463.568791:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694500352 00000100:00100000:2.0:1787787463.568791:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694500480 00000100:00100000:2.0:1787787463.568818:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787787463.568831:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1874630694500352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787463.568875:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1874630694500352:12345-0@lo:400:kworker.0 Request processed in 50us (114us total) trans 0 rc 0/0 00010000:00080000:0.0:1787787463.568960:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d071b1de1c0 x1874630694500224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787787473 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787463.568982:0:3290:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787787463.568991:0:3290:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787787463.568998:0:3290:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787787463.569003:0:3290:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787787463.569006:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9d0602993800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787787463.569013:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3290:1874630694500224:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787787463.569024:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787787463.569032:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874630694500480:12345-0@lo:400:kworker.0 00000020:01000000:0.0:1787787463.569040:0:15856:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787787463.569072:0:15856:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:3.0:1787787463.569078:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874630694500480:12345-0@lo:400:kworker.0 Request processed in 48us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787463.569084:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1787787463.569086:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0737a1c800/0xdeb1953cba4b226d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b2274 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787463.569095:0:15856:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d0737a1c800/0xdeb1953cba4b226d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b2274 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787787463.569139:0:15856:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787787463.569141:0:15856:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787787463.569142:0:15856:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787463.569144:0:15856:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787787463.569145:0:15856:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787463.569147:0:15856:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787463.569152:0:15856:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787787463.569154:0:15856:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787463.569155:0:15856:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787787463.569158:0:15856:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1787787463.569161:0:15856:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787787463.569162:0:15856:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787787463.569163:0:15856:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787463.569164:0:15856:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787787463.569165:0:15856:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787463.569166:0:15856:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787463.569166:0:15856:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787787463.569167:0:15856:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787463.569168:0:15856:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787787463.569184:0:15856:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787787463.569195:0:15856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e48f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694500608:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787787463.569244:0:15856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787463.569277:0:15856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071046c240 going to sleep for 11 seconds 00010000:00080000:1.0:1787787463.569337:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0705974780 x1874630694500480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787463.569348:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0705974780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1874630694500480:0@lo:400:kworker.0 00000100:00100000:2.0:1787787463.569384:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787787463.569415:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0705976580 x1874630694500352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787463.569425:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0705976580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1874630694500352:0@lo:400:kworker.0 00000100:00100000:3.0:1787787463.569629:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694500608 00000100:00100000:3.0:1787787463.569634:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694500608 00000100:00100000:3.0:1787787463.569668:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787787463.569675:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072de4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+19:15856:x1874630694500608:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787787463.569693:0:14453:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787787463.569707:0:14453:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787787463.596368:0:14453:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787787463.596388:0:14453:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787787463.596403:0:14476:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787787463.596408:0:14476:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787787463.596429:0:14476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d073fd39400/0xdeb1953cba4b2290 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787463.596474:0:14476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0737a1d000/0xdeb1953cba4b222e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b2227 expref: 19 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787463.596483:0:14476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d073fd39400/0xdeb1953cba4b2290 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787463.596519:0:14476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0737a1d000/0xdeb1953cba4b222e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b2227 expref: 19 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787463.596533:0:14476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d0737a1d000/0xdeb1953cba4b222e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b2227 expref: 19 pid: 14453 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787463.596566:0:14476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1de940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14476:1874630694500736:0@lo:104: 00000100:00100000:2.0:1787787463.596696:0:14476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787463.596733:0:14476:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07202eee40 going to sleep for 11 seconds 00000100:00100000:1.0:1787787463.596833:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694500736 00000100:00100000:1.0:1787787463.596840:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694500736 00000100:00100000:1.0:1787787463.596920:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787787463.596929:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+3:14476:x1874630694500736:12345-0@lo:104: 00010000:00010000:1.0:1787787463.596941:0:14445:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9d0708770600/0xdeb1953cba4b2227 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b222e expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787463.597012:0:14445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787787463.597018:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+3:14476:x1874630694500736:12345-0@lo:104: Request processed in 91us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787463.597026:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787787463.597056:0:14476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1de940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14476:1874630694500736:0@lo:104: 00010000:00010000:3.0:1787787463.597074:0:14476:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d073fd39400/0xdeb1953cba4b2290 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787463.597530:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787463.597537:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d0708770600/0xdeb1953cba4b2227 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b222e expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787463.597545:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708770600 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:1.0:1787787463.597549:0:14449:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d0708770600/0xdeb1953cba4b2227 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b222e expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787463.597557:0:14449:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d0708770600/0xdeb1953cba4b2227 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b222e expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787463.597578:0:14449:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d0708770600/0xdeb1953cba4b2227 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b222e expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787463.597583:0:14449:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787787463.598100:0:14449:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d0708770600/0xdeb1953cba4b2227 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b222e expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787463.598108:0:14449:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787463.598138:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d0708770600/0xdeb1953cba4b2227 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b222e expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787463.598146:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d0708770600/0xdeb1953cba4b2227 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b222e expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787463.598163:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787463.598166:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787463.598168:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787463.598176:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787787463.598189:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:3293:1874630694500864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787787463.598229:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787463.598814:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694500864 00000100:00100000:3.0:1787787463.598822:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694500864 00010000:00010000:3.0:1787787463.598848:0:14446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0737a1d000/0xdeb1953cba4b222e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b2227 expref: 20 pid: 14453 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787463.598888:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787787463.598896:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a083c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+20:3293:x1874630694500864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787787463.598909:0:14446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787463.598914:0:14446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0737a1d000/0xdeb1953cba4b222e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b2227 expref: 20 pid: 14453 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787463.598924:0:14446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0737a1d000/0xdeb1953cba4b222e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b2227 expref: 20 pid: 14453 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787463.598939:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0737a1d000/0xdeb1953cba4b222e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b2227 expref: 20 pid: 14453 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787463.598953:0:14446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d073fd39400/0xdeb1953cba4b2290 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787463.598979:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d073fd39400/0xdeb1953cba4b2290 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787787463.598994:0:14446:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014415966s 00010000:00010000:3.0:1787787463.598999:0:14446:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d073fd39400/0xdeb1953cba4b2290 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787463.599006:0:14446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d073fd39400/0xdeb1953cba4b2290 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787463.599013:0:14446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d073fd39400/0xdeb1953cba4b2290 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787463.599020:0:14446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d073fd39400/0xdeb1953cba4b2290 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787463.599025:0:14446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39400 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787463.599029:0:14446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d073fd39400/0xdeb1953cba4b2290 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787463.599037:0:14446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d073fd39400/0xdeb1953cba4b2290 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787463.599060:0:14446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d073fd39400/0xdeb1953cba4b2290 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787463.599069:0:14446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787463.599113:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a083c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+19:3293:x1874630694500864:12345-0@lo:103:ldlm_bl.0 Request processed in 218us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787463.599120:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787787463.599188:0:14476:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d073fd39400/0xdeb1953cba4b2290 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787463.599196:0:14476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d073fd39400/0xdeb1953cba4b2290 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787463.599203:0:14476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d073fd39400/0xdeb1953cba4b2290 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787463.599237:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:3293:1874630694500864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787463.604756:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072de4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+18:15856:x1874630694500608:12345-0@lo:253:mount.lustre.0 Request processed in 35072us (35502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787463.604768:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787787463.604837:0:15856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e48f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:15856:1874630694500608:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787787463.604851:0:15856:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787787463.604854:0:15856:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787787463.604855:0:15856:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787787463.604857:0:15856:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787463.604858:0:15856:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787787463.604859:0:15856:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787463.604860:0:15856:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787463.604862:0:15856:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787787463.604863:0:15856:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787463.604865:0:15856:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787787463.604878:0:15856:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787787463.609925:0:15856:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787787463.610113:0:15856:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787787463.610277:0:15856:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787787463.610418:0:15856:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787787463.610569:0:15856:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787787463.611015:0:15856:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787787463.611722:0:15856:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787787463.654574:0:15856:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787787463.654582:0:15856:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787787463.654681:0:15856:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787787463.654731:0:15856:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.110@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787787463.654744:0:15856:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787787463.654770:0:15856:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1787787464.252664:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787465.276750:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787787465.341348:0:14458:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787787465.341365:0:14458:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d0706340800 from 8 10000000:01000000:0.0:1787787465.341371:0:14458:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787787465.341429:0:14458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d07059fd800/0xdeb1953cba4b2297 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.341462:0:14458:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d07059fd800/0xdeb1953cba4b2297 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.341475:0:14458:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d07059fd800/0xdeb1953cba4b2297 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787465.341510:0:14458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e4ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694500992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787787465.341610:0:14458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787465.341670:0:14458:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071844b180 going to sleep for 11 seconds 00000100:00100000:0.0:1787787465.341707:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694500992 00000100:00100000:0.0:1787787465.341715:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694500992 00000100:00100000:0.0:1787787465.341770:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787787465.341780:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072de4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+18:14458:x1874630694500992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787465.341797:0:14454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787465.341824:0:14454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d07059fc600/0xdeb1953cba4b229e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b2297 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.341854:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d07059fc600/0xdeb1953cba4b229e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b2297 expref: 19 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.341867:0:14454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d07059fc600/0xdeb1953cba4b229e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b2297 expref: 19 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.341877:0:14454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d07059fc600, rc 0) 00000100:00100000:0.0:1787787465.341921:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072de4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+19:14458:x1874630694500992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787465.341936:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787787465.342005:0:14458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e4ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694500992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787465.342021:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d07059fd800/0xdeb1953cba4b2297 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b229e expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.342030:0:14458:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d07059fd800/0xdeb1953cba4b2297 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b229e expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787465.342082:0:14458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e4ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694501120:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787787465.342114:0:14458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787465.342134:0:14458:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d071844b180 going to sleep for 11 seconds 00000100:00100000:0.0:1787787465.342147:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694501120 00000100:00100000:0.0:1787787465.342151:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694501120 00000100:00100000:0.0:1787787465.342170:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787787465.342176:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072de4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+19:14458:x1874630694501120:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787787465.342191:0:14453:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787787465.342208:0:14453:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787787465.342212:0:14453:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1787787465.342283:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072de4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+19:14458:x1874630694501120:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 107us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787465.342290:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787787465.342321:0:14458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e4ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694501120:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787787465.342380:0:14458:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787787465.342387:0:14458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d07059fd800/0xdeb1953cba4b2297 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b229e expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.342403:0:14458:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d07059fd800/0xdeb1953cba4b2297 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b229e expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787465.597495:0:3290:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787787450/real 1787787450] req@ffff9d0705974f00 x1874630694493696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787465 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787465.597529:0:3290:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d0705974f00 x1874630694493696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787465 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787465.597540:0:3290:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787787450/real 1787787450] req@ffff9d0705974b40 x1874630694493824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787465 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787465.597550:0:3290:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d0705974b40 x1874630694493824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787465 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787787465.597572:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9d0707d5b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787787465.597589:0:3290:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787787465.597593:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0705974f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1874630694493696:0@lo:8:kworker.0 00000100:00080000:3.0:1787787465.597610:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9d0603728000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787787465.597615:0:3290:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787787465.597618:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0705974b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1874630694493824:0@lo:8:kworker.0 00000100:00080000:3.0:1787787465.597666:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787787465.597671:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787787465.597674:0:38:0:(import.c:65:import_set_state_nolock()) ffff9d0707d5b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787787465.597679:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 362 00000100:00080000:3.0:1787787465.597685:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787787465.597693:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d0707d5b000 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:3.0:1787787465.597732:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0705974b40 x1874630694501248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787787465.597764:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787787465.597767:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787787465.597769:0:38:0:(import.c:65:import_set_state_nolock()) ffff9d0603728000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787787465.597773:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 362 00000100:00080000:3.0:1787787465.597776:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787787465.597780:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d0603728000 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:3.0:1787787465.597793:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0705974f00 x1874630694501376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787787465.598004:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0705975a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1874630694501504:0@lo:400:kworker.0 00000100:00100000:3.0:1787787465.598082:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787465.598143:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787787465.598149:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0705975680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694501632:0@lo:400:kworker.0 00000100:00100000:3.0:1787787465.598173:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787465.598205:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787787465.598214:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07059770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1874630694501760:0@lo:400:kworker.0 00000100:00100000:3.0:1787787465.598245:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787465.598278:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694501504 00000100:00100000:3.0:1787787465.598287:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694501504 00000100:00100000:3.0:1787787465.600042:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694501632 00000100:00100000:3.0:1787787465.600057:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694501632 00000100:00080000:0.0:1787787465.600201:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787465.600238:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694501760 00000100:00100000:0.0:1787787465.600243:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694501760 00000100:00100000:0.0:1787787465.600279:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787787465.600290:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1874630694501504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787465.600400:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1874630694501504:12345-0@lo:400:kworker.0 Request processed in 112us (2317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787465.600408:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787787465.600429:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787787465.600435:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705976580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694501632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787465.600504:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705976580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874630694501632:12345-0@lo:400:kworker.0 Request processed in 70us (2330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787465.600511:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787787465.600524:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787787465.600530:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705974780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874630694501760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787465.600564:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705974780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874630694501760:12345-0@lo:400:kworker.0 Request processed in 35us (2318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787465.600570:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1787787465.600607:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787787465.601002:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d07059770c0 x1874630694501760/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787465.601022:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07059770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1874630694501760:0@lo:400:kworker.0 00000100:00100000:0.0:1787787465.601069:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0705974b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1874630694501248:0@lo:8:kworker.0 00000100:00100000:0.0:1787787465.601191:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787465.601240:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0705974f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1874630694501376:0@lo:8:kworker.0 00000100:00100000:0.0:1787787465.601273:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787787465.601357:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0705975680 x1874630694501632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787465.601368:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0705975680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1874630694501632:0@lo:400:kworker.0 00010000:00080000:0.0:1787787465.601387:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0705975a40 x1874630694501504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787465.601396:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0705975a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1874630694501504:0@lo:400:kworker.0 00000100:00100000:0.0:1787787465.603294:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694501248 00000100:00100000:0.0:1787787465.603316:0:15141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694501248 00000100:00100000:0.0:1787787465.603370:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694501376 00000100:00100000:0.0:1787787465.603374:0:15141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694501376 00000100:00100000:0.0:1787787465.603395:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787787465.603405:0:15141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3290:x1874630694501248:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787787465.603468:0:15141:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 377 last 0 00000020:00000080:0.0:1787787465.603502:0:15141:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdeb1953cba4b22a5 00002000:00100000:0.0:1787787465.603521:0:15141:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9d0715e4b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113934 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787787465.603526:0:15141:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787787465.603529:0:15141:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787787465.604230:0:15141:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787787465.604270:0:15141:0:(import.c:65:import_set_state_nolock()) ffff9d0715e4e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787787465.604386:0:15141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3290:x1874630694501248:12345-0@lo:8:kworker.0 Request processed in 980us (3193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787465.604401:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787787465.604423:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787787465.604428:0:15141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3290:x1874630694501376:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787787465.604474:0:15141:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 377 last 0 00000020:00000080:0.0:1787787465.604494:0:15141:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdeb1953cba4b22ac 00002000:00100000:0.0:1787787465.604504:0:15141:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9d0715e4b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113934 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787787465.604508:0:15141:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787787465.604510:0:15141:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787787465.605015:0:15141:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787787465.605034:0:15141:0:(import.c:65:import_set_state_nolock()) ffff9d0715e4a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787787465.605078:0:15141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3290:x1874630694501376:12345-0@lo:8:kworker.0 Request processed in 648us (3803us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787465.605085:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787787465.605116:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0705974b40 x1874630694501248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787787485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787465.605129:0:3290:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787787465.605139:0:3290:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787787465.605149:0:3290:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787787465.605155:0:3290:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787787465.605158:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9d0707d5b000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787787465.605185:0:3290:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787787465.605191:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0705974b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1874630694501248:0@lo:8:kworker.0 00010000:00080000:1.0:1787787465.605211:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0705974f00 x1874630694501376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787787485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787465.605219:0:3290:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787787465.605223:0:3290:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787787465.605228:0:3290:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787787465.605230:0:3290:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787787465.605233:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9d0603728000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787787465.605246:0:3290:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787787465.605249:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0705974f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1874630694501376:0@lo:8:kworker.0 00000004:00080000:1.0:1787787465.605319:0:14485:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:1.0:1787787465.605355:0:14485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0bc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14485:1874630694502016:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787787465.605402:0:14485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787465.605429:0:14485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0703187b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787787465.605467:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694501888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787787465.605505:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787465.605547:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694501888 00000100:00100000:1.0:1787787465.605549:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694502016 00000100:00100000:1.0:1787787465.605554:0:15144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694502016 00000100:00100000:0.0:1787787465.605555:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694501888 00000100:00100000:0.0:1787787465.605598:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000004:00080000:2.0:1787787465.605752:0:14483:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1787787465.605766:0:14483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1ded00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14483:1874630694502272:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787787465.605803:0:14483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787465.605821:0:14483:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0706ba8900 going to sleep for 11 seconds 00000004:00080000:3.0:1787787465.605987:0:14482:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787787465.606204:0:14484:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787787465.606624:0:14484:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 377833184726ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787787465.606657:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694502144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787465.606699:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787465.606849:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694502272 00000100:00100000:2.0:1787787465.606856:0:15143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694502272 00000100:00100000:2.0:1787787465.606896:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787787465.606904:0:15143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14483:x1874630694502272:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787787465.607300:0:14482:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 377833860969ns, next at 0ns, rc = 0 00000100:00100000:3.0:1787787465.607329:0:15146:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1787787465.607336:0:15146:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1787787465.607517:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1874630694501888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787787465.607551:0:15145:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787787465.607626:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1874630694501888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2020us (2119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787465.607635:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787787465.607775:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0707a08b40 x1874630694501888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787481 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787465.607942:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694501888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787787465.608092:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694502144 00000100:00100000:1.0:1787787465.608097:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694502144 00000100:00080000:0.0:1787787465.608232:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787787465.608237:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787787465.608764:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787787465.608775:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3291:x1874630694502144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787787465.608948:0:15146:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787787465.609039:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3291:x1874630694502144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 265us (2338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787465.609046:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787787465.609095:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d071b1dfc00 x1874630694502144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787481 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787465.609116:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694502144:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1787787465.616315:0:15143:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787787465.616329:0:15143:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1787787465.616468:0:15143:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:2.0:1787787465.627191:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787787465.627206:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a99f1c6/0xdeb1953cba4b22b3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.627227:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=377s v=(0 0) 00010000:00010000:2.0:1787787465.627233:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787465.627242:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a99f1c6/0xdeb1953cba4b22b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.627263:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a99f1c6/0xdeb1953cba4b22b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.627277:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a99f1c6/0xdeb1953cba4b22b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.627285:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a99f1c6/0xdeb1953cba4b22b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.627317:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787787465.628224:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787787465.628234:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c60587f2/0xdeb1953cba4b22ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.628246:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=377s v=(0 0) 00010000:00010000:2.0:1787787465.628250:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787465.628255:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c60587f2/0xdeb1953cba4b22ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.628273:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c60587f2/0xdeb1953cba4b22ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.628283:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c60587f2/0xdeb1953cba4b22ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.628290:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c60587f2/0xdeb1953cba4b22ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.628311:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787787465.628327:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787787465.628335:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a99f1c6/0xdeb1953cba4b22b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.628531:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd38400 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:2.0:1787787465.628537:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a99f1c6/0xdeb1953cba4b22b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.628548:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a99f1c6/0xdeb1953cba4b22b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.628570:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a99f1c6/0xdeb1953cba4b22b3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.628578:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a99f1c6/0xdeb1953cba4b22b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.628613:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787465.628617:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c60587f2/0xdeb1953cba4b22ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.628624:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39000 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:2.0:1787787465.628626:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c60587f2/0xdeb1953cba4b22ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.628633:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c60587f2/0xdeb1953cba4b22ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.628644:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c60587f2/0xdeb1953cba4b22ba lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.628650:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c60587f2/0xdeb1953cba4b22ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.628660:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787465.628662:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787465.628664:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787787465.629385:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787787465.629396:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6872a14/0xdeb1953cba4b22c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.629409:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=377s v=(0 0) 00010000:00010000:2.0:1787787465.629419:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787465.629425:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6872a14/0xdeb1953cba4b22c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.629464:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6872a14/0xdeb1953cba4b22c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.629475:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6872a14/0xdeb1953cba4b22c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.629483:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6872a14/0xdeb1953cba4b22c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.629503:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787787465.629515:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787465.629521:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6872a14/0xdeb1953cba4b22c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.629529:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39e00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:2.0:1787787465.629533:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6872a14/0xdeb1953cba4b22c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.629541:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6872a14/0xdeb1953cba4b22c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.629555:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6872a14/0xdeb1953cba4b22c1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.629575:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6872a14/0xdeb1953cba4b22c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.629591:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787465.629728:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787465.629731:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787787465.630250:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787787465.630258:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f513ebe/0xdeb1953cba4b22c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.630269:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=377s v=(0 0) 00010000:00010000:2.0:1787787465.630273:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787465.630277:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f513ebe/0xdeb1953cba4b22c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.630286:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f513ebe/0xdeb1953cba4b22c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.630295:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f513ebe/0xdeb1953cba4b22c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.630302:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f513ebe/0xdeb1953cba4b22c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.630319:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787787465.630328:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787465.631708:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f513ebe/0xdeb1953cba4b22c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.631727:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd38c00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:2.0:1787787465.631732:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f513ebe/0xdeb1953cba4b22c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.631743:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f513ebe/0xdeb1953cba4b22c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.631765:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f513ebe/0xdeb1953cba4b22c8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.631773:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f513ebe/0xdeb1953cba4b22c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.631797:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787465.631799:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787465.631802:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787465.632410:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787787465.634059:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787787465.634073:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf453d21/0xdeb1953cba4b22cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.634092:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=377s v=(0 0) 00010000:00010000:2.0:1787787465.634097:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787465.634105:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf453d21/0xdeb1953cba4b22cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.634133:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf453d21/0xdeb1953cba4b22cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.634145:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf453d21/0xdeb1953cba4b22cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.634153:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf453d21/0xdeb1953cba4b22cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.634176:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787787465.634192:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787465.634198:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf453d21/0xdeb1953cba4b22cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.634206:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd38e00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:2.0:1787787465.634210:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf453d21/0xdeb1953cba4b22cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.634220:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf453d21/0xdeb1953cba4b22cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.634238:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf453d21/0xdeb1953cba4b22cf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.634245:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf453d21/0xdeb1953cba4b22cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.634274:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787465.634275:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787465.634277:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787787465.636687:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787787465.636703:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e4bf8a8/0xdeb1953cba4b22d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.636724:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=377s v=(0 0) 00010000:00010000:2.0:1787787465.636729:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787465.636736:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e4bf8a8/0xdeb1953cba4b22d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.636752:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e4bf8a8/0xdeb1953cba4b22d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.636764:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e4bf8a8/0xdeb1953cba4b22d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.636773:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e4bf8a8/0xdeb1953cba4b22d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.636797:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787787465.637514:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787787465.637524:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdb9f9b7/0xdeb1953cba4b22dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.637547:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=377s v=(0 0) 00010000:00010000:2.0:1787787465.637551:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787465.637556:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdb9f9b7/0xdeb1953cba4b22dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.637568:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdb9f9b7/0xdeb1953cba4b22dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.637578:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdb9f9b7/0xdeb1953cba4b22dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.637586:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdb9f9b7/0xdeb1953cba4b22dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.637684:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787787465.637704:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787787465.637711:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e4bf8a8/0xdeb1953cba4b22d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.637720:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39600 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:2.0:1787787465.637726:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e4bf8a8/0xdeb1953cba4b22d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.637741:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e4bf8a8/0xdeb1953cba4b22d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.637777:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e4bf8a8/0xdeb1953cba4b22d6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.637785:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e4bf8a8/0xdeb1953cba4b22d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.637808:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787465.637811:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdb9f9b7/0xdeb1953cba4b22dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.637818:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39a00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:2.0:1787787465.637821:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdb9f9b7/0xdeb1953cba4b22dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.637829:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdb9f9b7/0xdeb1953cba4b22dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.638518:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdb9f9b7/0xdeb1953cba4b22dd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.638527:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdb9f9b7/0xdeb1953cba4b22dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.638545:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787465.638546:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787465.638554:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787787465.640325:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787787465.640408:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000009518/0xdeb1953cba4b22e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.640428:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=377s v=(0 0) 00010000:00010000:2.0:1787787465.640433:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787465.640465:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000009518/0xdeb1953cba4b22e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.640481:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000009518/0xdeb1953cba4b22e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.640492:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000009518/0xdeb1953cba4b22e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.640500:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000009518/0xdeb1953cba4b22e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.640521:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787787465.640537:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787465.640543:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000009518/0xdeb1953cba4b22e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.640551:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39400 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:2.0:1787787465.640555:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000009518/0xdeb1953cba4b22e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.640578:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000009518/0xdeb1953cba4b22e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.641044:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000009518/0xdeb1953cba4b22e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.641056:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000009518/0xdeb1953cba4b22e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.641083:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787465.641085:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787465.641087:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.642815:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787787465.646084:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787787465.646100:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7ea3c40/0xdeb1953cba4b22eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.646122:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=377s v=(0 0) 00010000:00010000:2.0:1787787465.646127:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787465.646135:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7ea3c40/0xdeb1953cba4b22eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.646152:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7ea3c40/0xdeb1953cba4b22eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.646164:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7ea3c40/0xdeb1953cba4b22eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.646180:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7ea3c40/0xdeb1953cba4b22eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.646202:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787787465.646219:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787465.646225:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7ea3c40/0xdeb1953cba4b22eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.646233:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0701646000 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:2.0:1787787465.646238:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7ea3c40/0xdeb1953cba4b22eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.646247:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7ea3c40/0xdeb1953cba4b22eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.646268:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7ea3c40/0xdeb1953cba4b22eb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.646275:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7ea3c40/0xdeb1953cba4b22eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.646296:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787465.646297:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787465.646299:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787787465.646965:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787787465.646982:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3f110cb/0xdeb1953cba4b22f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.646993:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=377s v=(0 0) 00010000:00010000:2.0:1787787465.646997:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787465.647001:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3f110cb/0xdeb1953cba4b22f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.647010:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3f110cb/0xdeb1953cba4b22f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.647019:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3f110cb/0xdeb1953cba4b22f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.647027:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3f110cb/0xdeb1953cba4b22f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.647052:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787787465.647540:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787787465.647548:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e58fc8e/0xdeb1953cba4b22f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.647559:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=377s v=(0 0) 00010000:00010000:2.0:1787787465.647563:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787465.647567:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e58fc8e/0xdeb1953cba4b22f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.647578:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e58fc8e/0xdeb1953cba4b22f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.647596:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e58fc8e/0xdeb1953cba4b22f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.647605:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e58fc8e/0xdeb1953cba4b22f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.647621:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787787465.647640:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787787465.647647:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3f110cb/0xdeb1953cba4b22f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.647656:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0701646800 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:2.0:1787787465.647660:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3f110cb/0xdeb1953cba4b22f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.647669:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3f110cb/0xdeb1953cba4b22f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.647687:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3f110cb/0xdeb1953cba4b22f2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.647696:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3f110cb/0xdeb1953cba4b22f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.647718:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787465.647729:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e58fc8e/0xdeb1953cba4b22f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.647737:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0701647c00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:2.0:1787787465.647740:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e58fc8e/0xdeb1953cba4b22f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.647748:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e58fc8e/0xdeb1953cba4b22f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.647759:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e58fc8e/0xdeb1953cba4b22f9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.647766:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e58fc8e/0xdeb1953cba4b22f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.647781:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787465.647782:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787465.647784:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787787465.651159:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787787465.651178:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f79511b/0xdeb1953cba4b2300 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.651199:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=377s v=(0 0) 00010000:00010000:2.0:1787787465.651204:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787465.651212:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f79511b/0xdeb1953cba4b2300 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.651245:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f79511b/0xdeb1953cba4b2300 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.651257:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f79511b/0xdeb1953cba4b2300 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.651265:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f79511b/0xdeb1953cba4b2300 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.651295:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787787465.651316:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787465.651323:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f79511b/0xdeb1953cba4b2300 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.651331:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0701646e00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:2.0:1787787465.652465:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f79511b/0xdeb1953cba4b2300 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.652487:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f79511b/0xdeb1953cba4b2300 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.652511:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f79511b/0xdeb1953cba4b2300 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.652519:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f79511b/0xdeb1953cba4b2300 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.652555:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787465.652558:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787465.652560:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.652730:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787787465.658316:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787787465.658333:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009036b26b/0xdeb1953cba4b2307 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.658426:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=377s v=(0 0) 00010000:00010000:3.0:1787787465.658432:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787465.658468:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009036b26b/0xdeb1953cba4b2307 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.658487:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009036b26b/0xdeb1953cba4b2307 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.658499:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009036b26b/0xdeb1953cba4b2307 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.658506:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009036b26b/0xdeb1953cba4b2307 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.658528:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787465.658542:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787465.658549:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009036b26b/0xdeb1953cba4b2307 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.658557:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708770200 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787465.658562:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009036b26b/0xdeb1953cba4b2307 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.658583:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009036b26b/0xdeb1953cba4b2307 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.658807:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009036b26b/0xdeb1953cba4b2307 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.658819:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009036b26b/0xdeb1953cba4b2307 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.658911:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.658914:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.658916:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787787465.662912:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787787465.662931:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffe311cf/0xdeb1953cba4b230e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.662965:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=377s v=(0 0) 00010000:00010000:3.0:1787787465.662971:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787465.662980:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffe311cf/0xdeb1953cba4b230e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.662998:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffe311cf/0xdeb1953cba4b230e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.663010:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffe311cf/0xdeb1953cba4b230e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.663035:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffe311cf/0xdeb1953cba4b230e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.663058:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787465.663074:0:14450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787465.663083:0:14450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffe311cf/0xdeb1953cba4b230e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.663093:0:14450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708770800 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787465.663099:0:14450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffe311cf/0xdeb1953cba4b230e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.663111:0:14450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffe311cf/0xdeb1953cba4b230e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787787465.664322:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787787465.664333:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f69eabe2/0xdeb1953cba4b2315 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.664782:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=377s v=(0 0) 00010000:00010000:1.0:1787787465.664787:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787465.664794:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f69eabe2/0xdeb1953cba4b2315 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.664824:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f69eabe2/0xdeb1953cba4b2315 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.664858:0:14450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffe311cf/0xdeb1953cba4b230e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.664905:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f69eabe2/0xdeb1953cba4b2315 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.664916:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f69eabe2/0xdeb1953cba4b2315 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.664926:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffe311cf/0xdeb1953cba4b230e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.664937:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787465.664963:0:14450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787465.664968:0:14450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f69eabe2/0xdeb1953cba4b2315 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.664986:0:14450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1c400 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787465.664990:0:14450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f69eabe2/0xdeb1953cba4b2315 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.664999:0:14450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f69eabe2/0xdeb1953cba4b2315 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.665011:0:14450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f69eabe2/0xdeb1953cba4b2315 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.665018:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f69eabe2/0xdeb1953cba4b2315 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.665033:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.665035:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.665037:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.665079:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787787465.665580:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787787465.665588:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e171f9f/0xdeb1953cba4b231c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.665772:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=377s v=(0 0) 00010000:00010000:1.0:1787787465.665776:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787465.665783:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e171f9f/0xdeb1953cba4b231c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.665794:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e171f9f/0xdeb1953cba4b231c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.665803:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e171f9f/0xdeb1953cba4b231c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.665821:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e171f9f/0xdeb1953cba4b231c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.665936:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787465.666037:0:14450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787465.666043:0:14450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e171f9f/0xdeb1953cba4b231c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.666051:0:14450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1c200 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787465.666054:0:14450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e171f9f/0xdeb1953cba4b231c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.666074:0:14450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e171f9f/0xdeb1953cba4b231c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.666089:0:14450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e171f9f/0xdeb1953cba4b231c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.666097:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e171f9f/0xdeb1953cba4b231c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.666219:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.666221:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.666223:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787787465.666515:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787787465.666522:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d8fedea/0xdeb1953cba4b2323 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.666533:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=377s v=(0 0) 00010000:00010000:1.0:1787787465.666537:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787465.666542:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d8fedea/0xdeb1953cba4b2323 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.666552:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d8fedea/0xdeb1953cba4b2323 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.666560:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d8fedea/0xdeb1953cba4b2323 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.666567:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d8fedea/0xdeb1953cba4b2323 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787787465.667192:0:5842:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:1.0:1787787465.667329:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787465.667330:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787465.667337:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d8fedea/0xdeb1953cba4b2323 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.667349:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1da00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787465.667352:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d8fedea/0xdeb1953cba4b2323 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.667361:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d8fedea/0xdeb1953cba4b2323 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.667379:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d8fedea/0xdeb1953cba4b2323 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.667405:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d8fedea/0xdeb1953cba4b2323 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.667425:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.667427:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.667428:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787787465.672006:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787787465.672142:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001568381/0xdeb1953cba4b232a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.672166:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=377s v=(0 0) 00010000:00010000:1.0:1787787465.672172:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787465.672179:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001568381/0xdeb1953cba4b232a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.672195:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001568381/0xdeb1953cba4b232a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.672207:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001568381/0xdeb1953cba4b232a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.672215:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001568381/0xdeb1953cba4b232a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.672240:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787465.672266:0:14450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787465.672281:0:14450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001568381/0xdeb1953cba4b232a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.672295:0:14450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1d600 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787465.672301:0:14450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001568381/0xdeb1953cba4b232a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.672313:0:14450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001568381/0xdeb1953cba4b232a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.672406:0:14450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001568381/0xdeb1953cba4b232a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.672416:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001568381/0xdeb1953cba4b232a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.672483:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.672487:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.672493:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787787465.672904:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787787465.672913:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074c9481d/0xdeb1953cba4b2331 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.672923:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=377s v=(0 0) 00010000:00010000:1.0:1787787465.672927:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787465.672932:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074c9481d/0xdeb1953cba4b2331 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.672944:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074c9481d/0xdeb1953cba4b2331 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.672977:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074c9481d/0xdeb1953cba4b2331 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.672985:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074c9481d/0xdeb1953cba4b2331 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.673520:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787465.674826:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787465.675083:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074c9481d/0xdeb1953cba4b2331 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.675100:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1d000 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787465.675106:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074c9481d/0xdeb1953cba4b2331 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.675119:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074c9481d/0xdeb1953cba4b2331 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.675148:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074c9481d/0xdeb1953cba4b2331 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.675156:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074c9481d/0xdeb1953cba4b2331 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.675192:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.675195:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.675199:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787787465.675310:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787787465.675322:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d8fedea/0xdeb1953cba4b2338 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.675340:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=377s v=(0 0) 00010000:00010000:1.0:1787787465.675345:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787465.675351:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d8fedea/0xdeb1953cba4b2338 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.675365:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d8fedea/0xdeb1953cba4b2338 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.675376:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d8fedea/0xdeb1953cba4b2338 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.675383:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d8fedea/0xdeb1953cba4b2338 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.676121:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787465.676219:0:14450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787465.676230:0:14450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d8fedea/0xdeb1953cba4b2338 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.676245:0:14450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1da00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787465.676250:0:14450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d8fedea/0xdeb1953cba4b2338 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.676277:0:14450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d8fedea/0xdeb1953cba4b2338 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.676297:0:14450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d8fedea/0xdeb1953cba4b2338 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.676305:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d8fedea/0xdeb1953cba4b2338 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.676829:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787787465.676893:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787787465.676902:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e171f9f/0xdeb1953cba4b233f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.676905:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.676911:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787465.676921:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=377s v=(0 0) 00010000:00010000:1.0:1787787465.676926:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787465.676932:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e171f9f/0xdeb1953cba4b233f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.676945:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e171f9f/0xdeb1953cba4b233f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.677006:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e171f9f/0xdeb1953cba4b233f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.677015:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e171f9f/0xdeb1953cba4b233f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.677115:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787465.677268:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787465.677277:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e171f9f/0xdeb1953cba4b233f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.677289:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1c200 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787465.677296:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e171f9f/0xdeb1953cba4b233f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.677308:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e171f9f/0xdeb1953cba4b233f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.677327:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e171f9f/0xdeb1953cba4b233f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.677428:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e171f9f/0xdeb1953cba4b233f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.677473:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.677476:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.677477:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787787465.677934:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787787465.677942:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f69eabe2/0xdeb1953cba4b2346 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.677963:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=377s v=(0 0) 00010000:00010000:1.0:1787787465.677973:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787465.677978:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f69eabe2/0xdeb1953cba4b2346 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.677990:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f69eabe2/0xdeb1953cba4b2346 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.677999:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f69eabe2/0xdeb1953cba4b2346 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.678007:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f69eabe2/0xdeb1953cba4b2346 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.678099:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787787465.678923:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787787465.678931:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b129cd9e/0xdeb1953cba4b234d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.678942:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=377s v=(0 0) 00010000:00010000:1.0:1787787465.678945:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787465.678959:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b129cd9e/0xdeb1953cba4b234d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.678971:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b129cd9e/0xdeb1953cba4b234d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.678979:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b129cd9e/0xdeb1953cba4b234d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.678993:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b129cd9e/0xdeb1953cba4b234d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.680989:0:14450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787787465.681010:0:14450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f69eabe2/0xdeb1953cba4b2346 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.681028:0:14450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1c400 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787465.681035:0:14450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f69eabe2/0xdeb1953cba4b2346 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.681049:0:14450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f69eabe2/0xdeb1953cba4b2346 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.681077:0:14450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f69eabe2/0xdeb1953cba4b2346 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.681086:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f69eabe2/0xdeb1953cba4b2346 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.681129:0:14450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787465.681134:0:14450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b129cd9e/0xdeb1953cba4b234d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.681160:0:14450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212ae00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787465.681164:0:14450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b129cd9e/0xdeb1953cba4b234d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.681174:0:14450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b129cd9e/0xdeb1953cba4b234d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.681187:0:14450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b129cd9e/0xdeb1953cba4b234d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.681198:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.681202:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.681205:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787465.681541:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787787465.681554:0:15143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b129cd9e/0xdeb1953cba4b234d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.681965:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787787465.682348:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787787465.682357:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f591b664/0xdeb1953cba4b2354 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.682372:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=377s v=(0 0) 00010000:00010000:1.0:1787787465.682376:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787465.682383:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f591b664/0xdeb1953cba4b2354 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.682543:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f591b664/0xdeb1953cba4b2354 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.682555:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f591b664/0xdeb1953cba4b2354 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.682564:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f591b664/0xdeb1953cba4b2354 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.682606:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787787465.682620:0:14450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787465.682625:0:14450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f591b664/0xdeb1953cba4b2354 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.682632:0:14450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212a800 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:1.0:1787787465.682636:0:14450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f591b664/0xdeb1953cba4b2354 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.682645:0:14450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f591b664/0xdeb1953cba4b2354 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.682662:0:14450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f591b664/0xdeb1953cba4b2354 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.682668:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f591b664/0xdeb1953cba4b2354 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.682685:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787465.682687:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787465.682689:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787787465.683379:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787787465.683386:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096aa4d16/0xdeb1953cba4b235b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.683626:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=377s v=(0 0) 00010000:00010000:1.0:1787787465.683637:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787465.683643:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096aa4d16/0xdeb1953cba4b235b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.683654:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096aa4d16/0xdeb1953cba4b235b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.683664:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096aa4d16/0xdeb1953cba4b235b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.683672:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096aa4d16/0xdeb1953cba4b235b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.683693:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787465.683717:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787465.683731:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096aa4d16/0xdeb1953cba4b235b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.683745:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212b200 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787465.683751:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096aa4d16/0xdeb1953cba4b235b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.683763:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096aa4d16/0xdeb1953cba4b235b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.683787:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096aa4d16/0xdeb1953cba4b235b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.683811:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096aa4d16/0xdeb1953cba4b235b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.683914:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.683919:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.683924:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787787465.684762:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787787465.684772:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ee10275/0xdeb1953cba4b2362 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.684785:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=377s v=(0 0) 00010000:00010000:1.0:1787787465.684789:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787465.684793:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ee10275/0xdeb1953cba4b2362 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.684805:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ee10275/0xdeb1953cba4b2362 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.684814:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ee10275/0xdeb1953cba4b2362 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.684828:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ee10275/0xdeb1953cba4b2362 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.684846:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787787465.684860:0:14450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787465.684865:0:14450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ee10275/0xdeb1953cba4b2362 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.684873:0:14450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212bc00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:1.0:1787787465.684877:0:14450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ee10275/0xdeb1953cba4b2362 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.684885:0:14450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ee10275/0xdeb1953cba4b2362 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.684900:0:14450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ee10275/0xdeb1953cba4b2362 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.684908:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ee10275/0xdeb1953cba4b2362 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.684929:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787465.684931:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787465.684933:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787787465.685723:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787787465.685742:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b7f7570/0xdeb1953cba4b2369 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.685752:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=377s v=(0 0) 00010000:00010000:1.0:1787787465.685756:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787465.685761:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b7f7570/0xdeb1953cba4b2369 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.685772:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b7f7570/0xdeb1953cba4b2369 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.685780:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b7f7570/0xdeb1953cba4b2369 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.685788:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b7f7570/0xdeb1953cba4b2369 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.685805:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1787787465.687113:0:15143:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1787787465.687217:0:15143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14483:x1874630694502272:12345-0@lo:5:osp-pre-0-0.0 Request processed in 80310us (81409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787465.687227:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787787465.687257:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787787465.687267:0:15143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a08780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14485:x1874630694502016:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787787465.688169:0:14483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1ded00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14483:1874630694502272:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787787465.688197:0:14483:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:0.0:1787787465.688294:0:14483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e4b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14483:1874630694502400:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787787465.688744:0:14483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787465.688794:0:15144:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787787465.688806:0:15144:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1787787465.688905:0:14483:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0703830300 going to sleep for 11 seconds 00010000:00010000:3.0:1787787465.691189:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787465.691207:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b7f7570/0xdeb1953cba4b2369 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.691223:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212a000 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787465.691230:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b7f7570/0xdeb1953cba4b2369 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.691243:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b7f7570/0xdeb1953cba4b2369 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.691274:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b7f7570/0xdeb1953cba4b2369 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.691284:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b7f7570/0xdeb1953cba4b2369 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.691321:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.691325:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.691328:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787465.692605:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694502400 00000100:00100000:1.0:1787787465.692623:0:15144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694502400 00000100:00100000:3.0:1787787465.692753:0:15989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787787465.692777:0:15989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14483:x1874630694502400:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787787465.693010:0:15989:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00002000:00080000:1.0:1787787465.693676:0:15143:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787787465.693685:0:15143:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1787787465.693689:0:15143:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00000100:00100000:2.0:1787787465.700811:0:15989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:14483:x1874630694502400:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8035us (12060us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787787465.700829:0:15989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787787465.701107:0:14483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e4b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14483:1874630694502400:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787787465.701130:0:14483:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00002000:00010000:0.0:1787787465.714346:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787787465.714367:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a82bc84f/0xdeb1953cba4b2370 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.714390:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1787787465.714396:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787465.714404:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a82bc84f/0xdeb1953cba4b2370 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.714428:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a82bc84f/0xdeb1953cba4b2370 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.714460:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a82bc84f/0xdeb1953cba4b2370 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.714470:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a82bc84f/0xdeb1953cba4b2370 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.714498:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787465.714537:0:14450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787465.714547:0:14450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a82bc84f/0xdeb1953cba4b2370 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.714556:0:14450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fd400 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787465.714561:0:14450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a82bc84f/0xdeb1953cba4b2370 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.714571:0:14450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a82bc84f/0xdeb1953cba4b2370 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.714601:0:14450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a82bc84f/0xdeb1953cba4b2370 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.714610:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a82bc84f/0xdeb1953cba4b2370 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.714636:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.714639:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.714641:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787787465.714975:0:5842:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1787787465.715694:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787787465.715704:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c22c3109/0xdeb1953cba4b2377 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.715718:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1787787465.715729:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787465.715735:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c22c3109/0xdeb1953cba4b2377 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.715749:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c22c3109/0xdeb1953cba4b2377 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.715761:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c22c3109/0xdeb1953cba4b2377 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.715769:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c22c3109/0xdeb1953cba4b2377 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.715826:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787787465.716393:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787787465.716401:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7598495/0xdeb1953cba4b237e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.716411:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1787787465.716414:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787465.716418:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7598495/0xdeb1953cba4b237e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.716429:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7598495/0xdeb1953cba4b237e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.716473:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7598495/0xdeb1953cba4b237e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.716489:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7598495/0xdeb1953cba4b237e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.716922:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787787465.716933:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c22c3109/0xdeb1953cba4b2377 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.716943:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fce00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787465.716948:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c22c3109/0xdeb1953cba4b2377 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.716970:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c22c3109/0xdeb1953cba4b2377 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.716993:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c22c3109/0xdeb1953cba4b2377 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.717001:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c22c3109/0xdeb1953cba4b2377 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.717024:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787465.717028:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7598495/0xdeb1953cba4b237e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.717035:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fc800 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787465.717039:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7598495/0xdeb1953cba4b237e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.717048:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7598495/0xdeb1953cba4b237e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.717072:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7598495/0xdeb1953cba4b237e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.717081:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.717083:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.717085:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787465.717131:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787787465.717137:0:15143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7598495/0xdeb1953cba4b237e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787787465.717706:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787787465.717714:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a7f60a2/0xdeb1953cba4b2385 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.717726:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1787787465.717730:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787465.717735:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a7f60a2/0xdeb1953cba4b2385 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.717747:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a7f60a2/0xdeb1953cba4b2385 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.717757:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a7f60a2/0xdeb1953cba4b2385 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.717766:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a7f60a2/0xdeb1953cba4b2385 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.717797:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787787465.718328:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787787465.718336:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3e28d15/0xdeb1953cba4b238c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.718347:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1787787465.718350:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787465.718355:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3e28d15/0xdeb1953cba4b238c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.718366:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3e28d15/0xdeb1953cba4b238c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.718375:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3e28d15/0xdeb1953cba4b238c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.718384:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3e28d15/0xdeb1953cba4b238c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.718394:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787787465.718982:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787787465.718993:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a7f60a2/0xdeb1953cba4b2385 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.719004:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fde00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:2.0:1787787465.719009:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a7f60a2/0xdeb1953cba4b2385 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.719019:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a7f60a2/0xdeb1953cba4b2385 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.719043:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a7f60a2/0xdeb1953cba4b2385 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.719052:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a7f60a2/0xdeb1953cba4b2385 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.719076:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787465.719080:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3e28d15/0xdeb1953cba4b238c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.719096:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fc200 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:2.0:1787787465.719100:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3e28d15/0xdeb1953cba4b238c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.719107:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3e28d15/0xdeb1953cba4b238c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.719118:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3e28d15/0xdeb1953cba4b238c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.719124:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3e28d15/0xdeb1953cba4b238c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.719140:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787465.719141:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787465.719143:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.719224:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787465.719393:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787787465.719401:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e4a61ff/0xdeb1953cba4b2393 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.719413:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1787787465.719424:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787465.719430:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e4a61ff/0xdeb1953cba4b2393 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.719467:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e4a61ff/0xdeb1953cba4b2393 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.719477:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e4a61ff/0xdeb1953cba4b2393 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.719485:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e4a61ff/0xdeb1953cba4b2393 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.719503:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787787465.719509:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787465.719514:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e4a61ff/0xdeb1953cba4b2393 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.719522:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fd000 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:2.0:1787787465.719525:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e4a61ff/0xdeb1953cba4b2393 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.719534:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e4a61ff/0xdeb1953cba4b2393 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.719551:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e4a61ff/0xdeb1953cba4b2393 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.719559:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e4a61ff/0xdeb1953cba4b2393 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.719575:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787465.719577:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787465.719578:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787465.720363:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787787465.720372:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0fb78b0/0xdeb1953cba4b239a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.720384:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1787787465.720388:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787465.720393:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0fb78b0/0xdeb1953cba4b239a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.720404:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0fb78b0/0xdeb1953cba4b239a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.720414:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0fb78b0/0xdeb1953cba4b239a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.720435:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0fb78b0/0xdeb1953cba4b239a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.720483:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787465.720516:0:14450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787465.720531:0:14450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0fb78b0/0xdeb1953cba4b239a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.720540:0:14450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fd200 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787465.720544:0:14450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0fb78b0/0xdeb1953cba4b239a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.720553:0:14450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0fb78b0/0xdeb1953cba4b239a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.720570:0:14450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0fb78b0/0xdeb1953cba4b239a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.720577:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0fb78b0/0xdeb1953cba4b239a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.720595:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.720596:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.720604:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787465.721264:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787787465.721272:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085dc642d/0xdeb1953cba4b23a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.721284:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1787787465.721287:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787465.721292:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085dc642d/0xdeb1953cba4b23a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.721303:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085dc642d/0xdeb1953cba4b23a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.721312:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085dc642d/0xdeb1953cba4b23a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.721320:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085dc642d/0xdeb1953cba4b23a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.721346:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787465.721941:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787465.721963:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085dc642d/0xdeb1953cba4b23a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.721973:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fc000 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787465.721977:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085dc642d/0xdeb1953cba4b23a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.721986:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085dc642d/0xdeb1953cba4b23a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787787465.721990:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787787465.721995:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f156c95/0xdeb1953cba4b23a8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.722003:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085dc642d/0xdeb1953cba4b23a1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.722009:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=377s v=(0 0) 00010000:00010000:3.0:1787787465.722011:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085dc642d/0xdeb1953cba4b23a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.722012:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787465.722017:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f156c95/0xdeb1953cba4b23a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.722027:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f156c95/0xdeb1953cba4b23a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.722029:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.722031:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.722033:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787465.722035:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f156c95/0xdeb1953cba4b23a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.722043:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f156c95/0xdeb1953cba4b23a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.722063:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787465.722117:0:14450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787465.722123:0:14450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f156c95/0xdeb1953cba4b23a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.722131:0:14450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fca00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787465.722134:0:14450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f156c95/0xdeb1953cba4b23a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.722155:0:14450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f156c95/0xdeb1953cba4b23a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.722166:0:14450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f156c95/0xdeb1953cba4b23a8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.722174:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f156c95/0xdeb1953cba4b23a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.722188:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.722190:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.722192:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787465.722615:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787787465.722621:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b2f06a9/0xdeb1953cba4b23af lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.722631:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1787787465.722701:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787465.722708:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b2f06a9/0xdeb1953cba4b23af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.722718:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b2f06a9/0xdeb1953cba4b23af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.722739:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b2f06a9/0xdeb1953cba4b23af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.722747:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b2f06a9/0xdeb1953cba4b23af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.722762:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787787465.723517:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787787465.723527:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083e4236c/0xdeb1953cba4b23b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.723538:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1787787465.723542:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787465.723546:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083e4236c/0xdeb1953cba4b23b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.723556:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083e4236c/0xdeb1953cba4b23b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.723562:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787465.723564:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083e4236c/0xdeb1953cba4b23b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.723571:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b2f06a9/0xdeb1953cba4b23af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.723572:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083e4236c/0xdeb1953cba4b23b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.723580:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fcc00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787465.723584:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b2f06a9/0xdeb1953cba4b23af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.723594:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b2f06a9/0xdeb1953cba4b23af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.723607:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787465.723611:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b2f06a9/0xdeb1953cba4b23af lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.723629:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b2f06a9/0xdeb1953cba4b23af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.723651:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787465.723654:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083e4236c/0xdeb1953cba4b23b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.723661:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d07059fdc00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787465.723664:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083e4236c/0xdeb1953cba4b23b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.723672:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083e4236c/0xdeb1953cba4b23b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.723684:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083e4236c/0xdeb1953cba4b23b6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.723685:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.723695:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083e4236c/0xdeb1953cba4b23b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.723709:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.723711:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.723713:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787465.724365:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787787465.724374:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b880e280/0xdeb1953cba4b23bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.724387:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1787787465.724390:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787465.724396:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b880e280/0xdeb1953cba4b23bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.724406:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b880e280/0xdeb1953cba4b23bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.724416:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b880e280/0xdeb1953cba4b23bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.724424:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b880e280/0xdeb1953cba4b23bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.724494:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787787465.725253:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787787465.725262:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000693dec2f/0xdeb1953cba4b23c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.725274:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1787787465.725284:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787465.725289:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000693dec2f/0xdeb1953cba4b23c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.725301:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000693dec2f/0xdeb1953cba4b23c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.725311:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000693dec2f/0xdeb1953cba4b23c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.725320:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000693dec2f/0xdeb1953cba4b23c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.725712:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787787465.725938:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787787465.725948:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b880e280/0xdeb1953cba4b23bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.725975:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d070141fc00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787465.725980:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b880e280/0xdeb1953cba4b23bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.725990:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b880e280/0xdeb1953cba4b23bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.726010:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b880e280/0xdeb1953cba4b23bd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.726018:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b880e280/0xdeb1953cba4b23bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.726040:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787465.726044:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000693dec2f/0xdeb1953cba4b23c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.726051:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d070141fe00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787465.726054:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000693dec2f/0xdeb1953cba4b23c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.726061:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000693dec2f/0xdeb1953cba4b23c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.726070:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000693dec2f/0xdeb1953cba4b23c4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.726083:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000693dec2f/0xdeb1953cba4b23c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.726096:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.726098:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.726100:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787465.726483:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787787465.726491:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058f73ea9/0xdeb1953cba4b23cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.726502:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1787787465.726505:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787465.726511:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058f73ea9/0xdeb1953cba4b23cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.726522:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058f73ea9/0xdeb1953cba4b23cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.726532:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058f73ea9/0xdeb1953cba4b23cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.726548:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058f73ea9/0xdeb1953cba4b23cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.726596:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787787465.726599:0:14450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787465.726608:0:14450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058f73ea9/0xdeb1953cba4b23cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.726619:0:14450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d070141e800 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:1.0:1787787465.726623:0:14450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058f73ea9/0xdeb1953cba4b23cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.726635:0:14450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058f73ea9/0xdeb1953cba4b23cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.726654:0:14450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058f73ea9/0xdeb1953cba4b23cb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.726662:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058f73ea9/0xdeb1953cba4b23cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.726681:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787465.726683:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787465.726685:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787465.727303:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787787465.727311:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecd1ba0f/0xdeb1953cba4b23d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.727321:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1787787465.727325:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787465.727329:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecd1ba0f/0xdeb1953cba4b23d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.727338:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecd1ba0f/0xdeb1953cba4b23d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.727346:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecd1ba0f/0xdeb1953cba4b23d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.727354:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecd1ba0f/0xdeb1953cba4b23d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.727426:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787787465.727909:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787787465.727917:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043aae460/0xdeb1953cba4b23d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.727932:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1787787465.727936:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787465.727940:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043aae460/0xdeb1953cba4b23d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.727960:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043aae460/0xdeb1953cba4b23d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.727969:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043aae460/0xdeb1953cba4b23d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.727976:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043aae460/0xdeb1953cba4b23d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.728197:0:14450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787787465.728205:0:14450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecd1ba0f/0xdeb1953cba4b23d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.728226:0:14450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d070141f600 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:1.0:1787787465.728230:0:14450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecd1ba0f/0xdeb1953cba4b23d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.728239:0:14450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecd1ba0f/0xdeb1953cba4b23d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.728256:0:14450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecd1ba0f/0xdeb1953cba4b23d2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.728265:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecd1ba0f/0xdeb1953cba4b23d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.728285:0:14450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787465.728289:0:14450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043aae460/0xdeb1953cba4b23d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.728295:0:14450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d070141ee00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:1.0:1787787465.728298:0:14450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043aae460/0xdeb1953cba4b23d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.728305:0:14450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043aae460/0xdeb1953cba4b23d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.728314:0:14450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043aae460/0xdeb1953cba4b23d9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.728329:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787465.728331:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787465.728332:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787465.728482:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787787465.728488:0:15143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043aae460/0xdeb1953cba4b23d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.728743:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787465.729377:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787787465.729385:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010336e68/0xdeb1953cba4b23e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.729400:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1787787465.729404:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787465.729409:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010336e68/0xdeb1953cba4b23e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.729434:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010336e68/0xdeb1953cba4b23e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.729566:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010336e68/0xdeb1953cba4b23e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.729574:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010336e68/0xdeb1953cba4b23e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.729643:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787787465.730264:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787787465.730272:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de97cc1e/0xdeb1953cba4b23e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.730284:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1787787465.730287:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787465.730293:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de97cc1e/0xdeb1953cba4b23e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.730304:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de97cc1e/0xdeb1953cba4b23e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.730314:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de97cc1e/0xdeb1953cba4b23e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.730332:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de97cc1e/0xdeb1953cba4b23e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.730342:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787787465.731884:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787787465.731899:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8e54f84/0xdeb1953cba4b23ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.731919:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1787787465.731924:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787465.731930:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8e54f84/0xdeb1953cba4b23ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.731942:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8e54f84/0xdeb1953cba4b23ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.731968:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8e54f84/0xdeb1953cba4b23ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.731976:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8e54f84/0xdeb1953cba4b23ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.731988:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1787787465.732570:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787787465.732578:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdfc9ca0/0xdeb1953cba4b23f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.732595:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1787787465.732598:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787465.732602:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdfc9ca0/0xdeb1953cba4b23f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.732612:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdfc9ca0/0xdeb1953cba4b23f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.732621:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdfc9ca0/0xdeb1953cba4b23f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.732629:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fdfc9ca0/0xdeb1953cba4b23f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.732714:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1787787465.733030:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787787465.733041:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010336e68/0xdeb1953cba4b23e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.733050:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d070141e000 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787465.733056:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010336e68/0xdeb1953cba4b23e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.733067:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010336e68/0xdeb1953cba4b23e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.733089:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010336e68/0xdeb1953cba4b23e0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.733097:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010336e68/0xdeb1953cba4b23e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.733233:0:14450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787787465.733241:0:14450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de97cc1e/0xdeb1953cba4b23e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.733249:0:14450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d060273c600 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:1.0:1787787465.733253:0:14450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de97cc1e/0xdeb1953cba4b23e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.733261:0:14450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de97cc1e/0xdeb1953cba4b23e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.733273:0:14450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de97cc1e/0xdeb1953cba4b23e7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.733281:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de97cc1e/0xdeb1953cba4b23e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.733297:0:14450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787787465.733301:0:14450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8e54f84/0xdeb1953cba4b23ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.733307:0:14450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d060273c400 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:1.0:1787787465.733319:0:14450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8e54f84/0xdeb1953cba4b23ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.733327:0:14450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8e54f84/0xdeb1953cba4b23ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.733337:0:14450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8e54f84/0xdeb1953cba4b23ee lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.733345:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8e54f84/0xdeb1953cba4b23ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.733358:0:14450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787465.733361:0:14450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fdfc9ca0/0xdeb1953cba4b23f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.733367:0:14450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d060273ca00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:1.0:1787787465.733370:0:14450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdfc9ca0/0xdeb1953cba4b23f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.733377:0:14450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdfc9ca0/0xdeb1953cba4b23f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.733385:0:14450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fdfc9ca0/0xdeb1953cba4b23f5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.733392:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdfc9ca0/0xdeb1953cba4b23f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.733409:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787465.733410:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787465.733412:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787465.733419:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787465.733420:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787465.733422:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787465.733606:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787787465.733612:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086d3ef3a/0xdeb1953cba4b23fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.733623:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1787787465.733626:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787465.733632:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086d3ef3a/0xdeb1953cba4b23fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.733854:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086d3ef3a/0xdeb1953cba4b23fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.733876:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086d3ef3a/0xdeb1953cba4b23fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.733883:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086d3ef3a/0xdeb1953cba4b23fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.733939:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787787465.734513:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787787465.734520:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015fd91eb/0xdeb1953cba4b2403 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.734532:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1787787465.734536:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787465.734541:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015fd91eb/0xdeb1953cba4b2403 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.734551:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015fd91eb/0xdeb1953cba4b2403 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.734560:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015fd91eb/0xdeb1953cba4b2403 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.734568:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015fd91eb/0xdeb1953cba4b2403 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.734741:0:14450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787787465.734749:0:14450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086d3ef3a/0xdeb1953cba4b23fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.734758:0:14450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d060273da00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:1.0:1787787465.734762:0:14450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086d3ef3a/0xdeb1953cba4b23fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.734771:0:14450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086d3ef3a/0xdeb1953cba4b23fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.734792:0:14450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086d3ef3a/0xdeb1953cba4b23fc lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.734800:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086d3ef3a/0xdeb1953cba4b23fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.734819:0:14450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787465.734822:0:14450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015fd91eb/0xdeb1953cba4b2403 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.734855:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787787465.734918:0:14450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d060273d000 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:1.0:1787787465.734922:0:14450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015fd91eb/0xdeb1953cba4b2403 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.734930:0:14450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015fd91eb/0xdeb1953cba4b2403 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.734941:0:14450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015fd91eb/0xdeb1953cba4b2403 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.734948:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015fd91eb/0xdeb1953cba4b2403 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787465.734976:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787465.734977:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787465.734979:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.735188:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787465.735405:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787787465.735411:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0b39e7d/0xdeb1953cba4b240a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.735421:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1787787465.735424:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787465.735428:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0b39e7d/0xdeb1953cba4b240a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.735498:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0b39e7d/0xdeb1953cba4b240a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.735508:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0b39e7d/0xdeb1953cba4b240a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.735515:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0b39e7d/0xdeb1953cba4b240a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.735564:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787787465.736034:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787787465.736041:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000790288a0/0xdeb1953cba4b2411 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.736050:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1787787465.736069:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787465.736074:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000790288a0/0xdeb1953cba4b2411 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.736084:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000790288a0/0xdeb1953cba4b2411 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.736093:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000790288a0/0xdeb1953cba4b2411 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.736101:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000790288a0/0xdeb1953cba4b2411 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.736378:0:14450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787787465.736388:0:14450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0b39e7d/0xdeb1953cba4b240a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.736405:0:14450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d060273c200 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787465.736410:0:14450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0b39e7d/0xdeb1953cba4b240a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.736419:0:14450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0b39e7d/0xdeb1953cba4b240a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.736461:0:14450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0b39e7d/0xdeb1953cba4b240a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.736471:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0b39e7d/0xdeb1953cba4b240a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.736596:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787787465.736611:0:14450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787465.736617:0:14450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000790288a0/0xdeb1953cba4b2411 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.736625:0:14450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d060273c000 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:2.0:1787787465.736629:0:14450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000790288a0/0xdeb1953cba4b2411 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.736637:0:14450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000790288a0/0xdeb1953cba4b2411 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.736650:0:14450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000790288a0/0xdeb1953cba4b2411 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.736657:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000790288a0/0xdeb1953cba4b2411 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.736686:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787465.736687:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787465.737296:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787787465.737305:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb38d074/0xdeb1953cba4b2418 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.737318:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1787787465.737321:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787465.737326:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb38d074/0xdeb1953cba4b2418 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.737337:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb38d074/0xdeb1953cba4b2418 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.737346:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb38d074/0xdeb1953cba4b2418 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.737357:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb38d074/0xdeb1953cba4b2418 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.737385:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787465.737386:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.737391:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb38d074/0xdeb1953cba4b2418 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.737398:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d060273ce00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787465.737402:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb38d074/0xdeb1953cba4b2418 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.737411:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb38d074/0xdeb1953cba4b2418 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.737427:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb38d074/0xdeb1953cba4b2418 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.737489:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.737491:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.737493:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787465.737573:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787465.737578:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787787465.737583:0:15143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb38d074/0xdeb1953cba4b2418 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787787465.738325:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787787465.738334:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058137f8d/0xdeb1953cba4b241f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.738346:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1787787465.738350:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787465.738355:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058137f8d/0xdeb1953cba4b241f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.738366:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058137f8d/0xdeb1953cba4b241f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.738375:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058137f8d/0xdeb1953cba4b241f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.738383:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058137f8d/0xdeb1953cba4b241f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.738419:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787465.738748:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787465.738756:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058137f8d/0xdeb1953cba4b241f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.738765:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d060273dc00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787465.738769:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058137f8d/0xdeb1953cba4b241f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.738791:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058137f8d/0xdeb1953cba4b241f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.738807:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058137f8d/0xdeb1953cba4b241f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.738815:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058137f8d/0xdeb1953cba4b241f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.738835:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.738837:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.738839:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787465.739973:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787787465.739987:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9d0d806/0xdeb1953cba4b2426 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.740002:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1787787465.740006:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787465.740014:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9d0d806/0xdeb1953cba4b2426 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.740026:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9d0d806/0xdeb1953cba4b2426 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.740037:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9d0d806/0xdeb1953cba4b2426 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.740044:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9d0d806/0xdeb1953cba4b2426 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.740069:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787787465.740194:0:14450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787465.740203:0:14450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9d0d806/0xdeb1953cba4b2426 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.740212:0:14450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d060273c800 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:2.0:1787787465.740215:0:14450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9d0d806/0xdeb1953cba4b2426 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.740224:0:14450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9d0d806/0xdeb1953cba4b2426 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.740242:0:14450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9d0d806/0xdeb1953cba4b2426 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.740250:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9d0d806/0xdeb1953cba4b2426 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.740272:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787465.740274:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787465.740276:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787465.740591:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787787465.740598:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e78a79f/0xdeb1953cba4b242d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.740607:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1787787465.740618:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787465.740623:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e78a79f/0xdeb1953cba4b242d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.740634:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e78a79f/0xdeb1953cba4b242d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.740767:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e78a79f/0xdeb1953cba4b242d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.740774:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e78a79f/0xdeb1953cba4b242d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787465.740790:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1787787465.740995:0:15143:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00010000:00010000:3.0:1787787465.741210:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787465.741217:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e78a79f/0xdeb1953cba4b242d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.741237:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d060273d600 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787465.741241:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e78a79f/0xdeb1953cba4b242d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787465.741246:0:14485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0bc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14485:1874630694502016:0@lo:5:osp-pre-1-0.0 00010000:00010000:3.0:1787787465.741250:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e78a79f/0xdeb1953cba4b242d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.741265:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e78a79f/0xdeb1953cba4b242d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787787465.741269:0:14485:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00010000:00010000:3.0:1787787465.741272:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e78a79f/0xdeb1953cba4b242d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.741290:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.741292:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.741293:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787465.741334:0:15143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a08780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14485:x1874630694502016:12345-0@lo:5:osp-pre-1-0.0 Request processed in 54069us (135930us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787465.741335:0:14485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1ded00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14485:1874630694502528:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787787465.741346:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787787465.741381:0:14485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787465.741463:0:14485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07093d5240 going to sleep for 11 seconds 00000100:00100000:0.0:1787787465.741515:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694502528 00000100:00100000:0.0:1787787465.741523:0:15144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694502528 00000100:00100000:0.0:1787787465.741657:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787787465.741669:0:15144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14485:x1874630694502528:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787787465.741715:0:15144:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1787787465.751684:0:15144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14485:x1874630694502528:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10001us (10286us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787787465.751705:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787787465.752513:0:14485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1ded00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14485:1874630694502528:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787787465.752537:0:14485:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1787787466.301416:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787787467.233106:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787787467.233405:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:1.0:1787787467.327823:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787468.348542:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787787468.802002:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1787787468.802044:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:02000400:0.0:1787787469.250859:0:16215:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787787469.372680:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787470.398082:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787470.716699:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:3292:1874630694502656:0@lo:400:kworker.0 00000100:00100000:1.0:1787787470.716763:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787470.716810:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1874630694503168:0@lo:400:kworker.0 00000100:00100000:1.0:1787787470.716836:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787470.716861:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787787470.716867:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874630694503040:0@lo:400:kworker.0 00000100:00100000:1.0:1787787470.716888:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787470.716912:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694502784:0@lo:400:kworker.0 00000100:00100000:1.0:1787787470.716962:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787470.716977:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1874630694503296:0@lo:400:kworker.0 00000100:00100000:1.0:1787787470.717000:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787470.717015:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787787470.717020:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0707a092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694502912:0@lo:400:kworker.0 00000100:00100000:1.0:1787787470.717038:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787470.717070:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694502656 00000100:00100000:1.0:1787787470.717077:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694502656 00000100:00100000:1.0:1787787470.717122:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787787470.717131:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072de4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+19:3292:x1874630694502656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787470.717175:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072de4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+19:3292:x1874630694502656:12345-0@lo:400:kworker.0 Request processed in 45us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787470.717182:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787787470.717210:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694503168 00000100:00100000:1.0:1787787470.717214:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694503168 00000100:00100000:1.0:1787787470.717242:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694503040 00000100:00100000:1.0:1787787470.717245:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694503040 00000100:00100000:1.0:1787787470.717255:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694503296 00000100:00100000:1.0:1787787470.717258:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694503296 00000100:00100000:1.0:1787787470.717273:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787787470.717278:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1874630694503168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787470.717307:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1874630694503168:12345-0@lo:400:kworker.0 Request processed in 29us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787470.717313:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787787470.717324:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787787470.717330:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1874630694503040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787470.717353:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1874630694503040:12345-0@lo:400:kworker.0 Request processed in 23us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787470.717364:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787787470.717376:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787787470.717381:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874630694503296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787470.717409:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874630694503296:12345-0@lo:400:kworker.0 Request processed in 28us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787470.717416:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787787470.717432:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787787470.717478:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0707a0a580 x1874630694503296/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787470.717492:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1874630694503296:0@lo:400:kworker.0 00010000:00080000:1.0:1787787470.717517:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0707a0a1c0 x1874630694503040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787470.717526:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874630694503040:0@lo:400:kworker.0 00000100:00100000:1.0:1787787470.717533:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:3292:1874630694502656:0@lo:400:kworker.0 00010000:00080000:1.0:1787787470.717541:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0707a0b840 x1874630694503168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787470.717548:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1874630694503168:0@lo:400:kworker.0 00000100:00100000:3.0:1787787470.717654:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787787470.717663:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0705976d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694503424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787787470.717698:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787470.717732:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694503424 00000100:00100000:3.0:1787787470.717736:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694503424 00000100:00100000:3.0:1787787470.717770:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787787470.717779:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694503424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787787470.717816:0:15146:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787787470.717858:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694503424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787470.717865:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787787470.717894:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787787470.717909:0:3293:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787787470.717939:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0705976d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694503424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787470.718128:0:15989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694502784 00000100:00100000:2.0:1787787470.718132:0:15989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694502784 00000100:00100000:2.0:1787787470.718158:0:15989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694502912 00000100:00100000:2.0:1787787470.718161:0:15989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694502912 00000100:00100000:2.0:1787787470.718185:0:15989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787787470.718192:0:15989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694502784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787470.718233:0:15989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694502784:12345-0@lo:400:kworker.0 Request processed in 42us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787470.718240:0:15989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787787470.718256:0:15989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787787470.718261:0:15989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694502912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787470.718291:0:15989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694502912:12345-0@lo:400:kworker.0 Request processed in 29us (1251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787470.718298:0:15989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787787470.718318:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787787470.718332:0:3293:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787787470.718342:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694502912:0@lo:400:kworker.0 00000100:00100000:2.0:1787787470.718351:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0707a0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694502784:0@lo:400:kworker.0 00000100:00100000:1.0:1787787470.719677:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694503552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787787470.719730:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787470.722850:0:15985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694503552 00000100:00100000:2.0:1787787470.722865:0:15985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694503552 00000100:00100000:2.0:1787787470.722913:0:15985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787787470.722934:0:15985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694503552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787787470.722969:0:15985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787470.723048:0:15985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694503552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (3319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787470.723056:0:15985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787787470.723609:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694503552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787787471.287793:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787471.287940:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678781696 00000100:00100000:0.0:1787787471.287949:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678781696 00000100:00100000:0.0:1787787471.287993:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 74 00000100:00100000:0.0:1787787471.288000:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072de4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2341:x1874630678781696:12345-192.168.206.10@tcp:250:mount.lustre.0 00010000:00080000:0.0:1787787471.288026:0:14454:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 4c13b403-cfe9-4f44-8f22-4e16a974f4be@192.168.206.10@tcp t0 exp 0000000000000000 cur 383 last 0 00000020:00000080:0.0:1787787471.288053:0:14454:0:(genops.c:1385:class_connect()) connect: client 4c13b403-cfe9-4f44-8f22-4e16a974f4be, cookie 0xdeb1953cba4b2434 00000100:00080000:0.0:1787787471.288206:0:14454:0:(import.c:65:import_set_state_nolock()) ffff9d0715e48800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787787471.288274:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072de4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c13b403-cfe9-4f44-8f22-4e16a974f4be+5:2341:x1874630678781696:12345-192.168.206.10@tcp:250:mount.lustre.0 Request processed in 272us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787471.288290:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 74 00000100:00100000:0.0:1787787471.300500:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787471.300623:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678781824 00000100:00100000:1.0:1787787471.300643:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678781824 00000100:00100000:1.0:1787787471.300700:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 75 00000100:00100000:1.0:1787787471.300710:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07346c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c13b403-cfe9-4f44-8f22-4e16a974f4be+5:13758:x1874630678781824:12345-192.168.206.10@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787787471.300725:0:14453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787471.300742:0:14453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d072212b000/0xdeb1953cba4b243b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35430 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787471.300771:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d072212b000/0xdeb1953cba4b243b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35430 expref: 6 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787471.300781:0:14453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d072212b000/0xdeb1953cba4b243b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35430 expref: 6 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787471.300790:0:14453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d072212b000, rc 0) 00000100:00100000:1.0:1787787471.300944:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07346c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c13b403-cfe9-4f44-8f22-4e16a974f4be+6:13758:x1874630678781824:12345-192.168.206.10@tcp:101:mount.lustre.0 Request processed in 235us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787471.300951:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 75 00000100:00100000:2.0:1787787471.308746:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787471.308986:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678781952 00000100:00100000:1.0:1787787471.308996:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678781952 00000100:00100000:1.0:1787787471.309096:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 76 00000100:00100000:1.0:1787787471.309106:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07346c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c13b403-cfe9-4f44-8f22-4e16a974f4be+6:13758:x1874630678781952:12345-192.168.206.10@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787787471.309788:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07346c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c13b403-cfe9-4f44-8f22-4e16a974f4be+6:13758:x1874630678781952:12345-192.168.206.10@tcp:501:mount.lustre.0 Request processed in 672us (1040us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787787471.309800:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 76 00000100:00100000:3.0:1787787471.316114:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787471.316206:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678782080 00000100:00100000:1.0:1787787471.316216:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678782080 00000100:00100000:1.0:1787787471.316327:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 77 00000100:00100000:1.0:1787787471.316339:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07346c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c13b403-cfe9-4f44-8f22-4e16a974f4be+6:13758:x1874630678782080:12345-192.168.206.10@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787787471.316372:0:14453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787471.316391:0:14453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d072212b800/0xdeb1953cba4b2442 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35437 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787471.316420:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d072212b800/0xdeb1953cba4b2442 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35437 expref: 7 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787471.316431:0:14453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d072212b800/0xdeb1953cba4b2442 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35437 expref: 7 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787471.316474:0:14453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d072212b800, rc 0) 00000100:00100000:1.0:1787787471.316523:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07346c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c13b403-cfe9-4f44-8f22-4e16a974f4be+7:13758:x1874630678782080:12345-192.168.206.10@tcp:101:mount.lustre.0 Request processed in 187us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787471.316531:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 77 00000100:00100000:2.0:1787787471.321099:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787471.321365:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678782208 00000100:00100000:1.0:1787787471.321375:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678782208 00000100:00100000:1.0:1787787471.321426:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 78 00000100:00100000:1.0:1787787471.321686:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07346c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c13b403-cfe9-4f44-8f22-4e16a974f4be+7:13758:x1874630678782208:12345-192.168.206.10@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787787471.322018:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07346c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c13b403-cfe9-4f44-8f22-4e16a974f4be+8:13758:x1874630678782208:12345-192.168.206.10@tcp:501:mount.lustre.0 Request processed in 582us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787471.322026:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 78 00000100:00100000:2.0:1787787471.324204:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787471.324531:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678782336 00000100:00100000:1.0:1787787471.324540:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678782336 00000100:00100000:1.0:1787787471.324803:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 79 00000100:00100000:1.0:1787787471.324815:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07346cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c13b403-cfe9-4f44-8f22-4e16a974f4be+8:13758:x1874630678782336:12345-192.168.206.10@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787787471.325178:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07346cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c13b403-cfe9-4f44-8f22-4e16a974f4be+8:13758:x1874630678782336:12345-192.168.206.10@tcp:503:mount.lustre.0 Request processed in 364us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787471.325193:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 79 00000100:00100000:3.0:1787787471.344270:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787471.344758:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678782464 00000100:00100000:1.0:1787787471.344779:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678782464 00000100:00100000:1.0:1787787471.344845:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 80 00000100:00100000:1.0:1787787471.344855:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07346c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c13b403-cfe9-4f44-8f22-4e16a974f4be+8:13776:x1874630678782464:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787787471.345209:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07346c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c13b403-cfe9-4f44-8f22-4e16a974f4be+8:13776:x1874630678782464:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 354us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787471.345218:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 80 00000100:00100000:2.0:1787787471.365428:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787471.365940:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678782592 00000100:00100000:1.0:1787787471.365951:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678782592 00000100:00100000:1.0:1787787471.366006:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 81 00000100:00100000:1.0:1787787471.366015:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07346cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c13b403-cfe9-4f44-8f22-4e16a974f4be+8:13776:x1874630678782592:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787787471.366681:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07346cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c13b403-cfe9-4f44-8f22-4e16a974f4be+8:13776:x1874630678782592:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 664us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787471.366692:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 81 00000100:00100000:2.0:1787787471.372902:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787471.373069:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678782720 00000100:00100000:0.0:1787787471.373079:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678782720 00000100:00100000:0.0:1787787471.373141:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 82 00000100:00100000:0.0:1787787471.373150:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07346ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c13b403-cfe9-4f44-8f22-4e16a974f4be+8:13758:x1874630678782720:12345-192.168.206.10@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787787471.373165:0:14454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787471.373181:0:14454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d060273d800/0xdeb1953cba4b2449 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35461 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787471.373218:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d060273d800/0xdeb1953cba4b2449 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35461 expref: 9 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787471.373230:0:14454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d060273d800/0xdeb1953cba4b2449 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35461 expref: 9 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787471.373254:0:14454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d060273d800, rc 0) 00000100:00100000:0.0:1787787471.373318:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07346ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c13b403-cfe9-4f44-8f22-4e16a974f4be+9:13758:x1874630678782720:12345-192.168.206.10@tcp:101:mount.lustre.0 Request processed in 162us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787471.373325:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 82 00000100:00100000:2.0:1787787471.383557:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787471.383995:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678782848 00000100:00100000:1.0:1787787471.384005:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678782848 00000100:00100000:1.0:1787787471.384101:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 83 00000100:00100000:1.0:1787787471.384111:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07346cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c13b403-cfe9-4f44-8f22-4e16a974f4be+9:13758:x1874630678782848:12345-192.168.206.10@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787787471.384146:0:14453:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787787471.384177:0:14453:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787787471.384181:0:14453:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787787471.384184:0:14453:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787787471.384187:0:14453:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1787787471.391026:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07346cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c13b403-cfe9-4f44-8f22-4e16a974f4be+9:13758:x1874630678782848:12345-192.168.206.10@tcp:256:mount.lustre.0 Request processed in 6906us (7467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787471.391050:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 83 00000100:00100000:2.0:1787787471.395989:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787471.397333:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678782976 00000100:00100000:1.0:1787787471.397347:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678782976 00000100:00100000:1.0:1787787471.398747:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 84 00000100:00100000:1.0:1787787471.398767:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07346c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c13b403-cfe9-4f44-8f22-4e16a974f4be+9:13758:x1874630678782976:12345-192.168.206.10@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787787471.398783:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787471.398801:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d072212a600/0xdeb1953cba4b2450 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35468 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787471.398842:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d072212a600/0xdeb1953cba4b2450 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35468 expref: 10 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787471.398854:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d072212a600/0xdeb1953cba4b2450 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35468 expref: 10 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787471.398863:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d072212a600, rc 0) 00000100:00100000:1.0:1787787471.398935:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07346c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c13b403-cfe9-4f44-8f22-4e16a974f4be+10:13758:x1874630678782976:12345-192.168.206.10@tcp:101:mount.lustre.0 Request processed in 176us (2953us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787471.398943:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 84 00000100:00100000:3.0:1787787471.400878:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787471.401012:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678783104 00000100:00100000:0.0:1787787471.401024:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678783104 00000100:00100000:0.0:1787787471.401144:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 85 00000100:00100000:0.0:1787787471.401155:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07346c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c13b403-cfe9-4f44-8f22-4e16a974f4be+10:13758:x1874630678783104:12345-192.168.206.10@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787787471.401554:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07346c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c13b403-cfe9-4f44-8f22-4e16a974f4be+10:13758:x1874630678783104:12345-192.168.206.10@tcp:501:mount.lustre.0 Request processed in 399us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787471.401564:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 85 00000100:00100000:0.0:1787787471.405256:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787471.405947:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678783232 00000100:00100000:1.0:1787787471.405961:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678783232 00000100:00100000:1.0:1787787471.406086:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 86 00000100:00100000:1.0:1787787471.406099:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07346ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c13b403-cfe9-4f44-8f22-4e16a974f4be+10:13758:x1874630678783232:12345-192.168.206.10@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787787471.407086:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07346ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c13b403-cfe9-4f44-8f22-4e16a974f4be+10:13758:x1874630678783232:12345-192.168.206.10@tcp:503:mount.lustre.0 Request processed in 985us (1838us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787471.407097:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 86 00000100:00100000:3.0:1787787471.412154:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787471.412276:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678783360 00000100:00100000:0.0:1787787471.412288:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678783360 00000100:00100000:0.0:1787787471.412591:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 87 00000100:00100000:0.0:1787787471.412604:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07346cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c13b403-cfe9-4f44-8f22-4e16a974f4be+10:13780:x1874630678783360:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787787471.412973:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07346cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c13b403-cfe9-4f44-8f22-4e16a974f4be+10:13780:x1874630678783360:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 369us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787471.412982:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 87 00000100:00100000:3.0:1787787471.418697:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787471.418940:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678783488 00000100:00100000:1.0:1787787471.418953:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678783488 00000100:00100000:1.0:1787787471.419027:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 88 00000100:00100000:1.0:1787787471.419039:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07346c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c13b403-cfe9-4f44-8f22-4e16a974f4be+10:13780:x1874630678783488:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787787471.419355:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07346c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c13b403-cfe9-4f44-8f22-4e16a974f4be+10:13780:x1874630678783488:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 318us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787471.419365:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 88 00010000:00010000:2.0:1787787471.420715:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787471.440726:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787471.441079:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678783616 00000100:00100000:0.0:1787787471.441093:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678783616 00000100:00100000:0.0:1787787471.441149:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:0.0:1787787471.441158:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2341:x1874630678783616:12345-192.168.206.10@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787787471.441196:0:14462:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from e0afca4d-e329-45bc-884c-b1ba8eafd358@192.168.206.10@tcp t0 exp 0000000000000000 cur 383 last 0 00000020:00000080:0.0:1787787471.441277:0:14462:0:(genops.c:1385:class_connect()) connect: client e0afca4d-e329-45bc-884c-b1ba8eafd358, cookie 0xdeb1953cba4b2457 00000004:00100000:0.0:1787787471.441326:0:14462:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1787787471.441334:0:14462:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1787787471.505427:0:14462:0:(import.c:65:import_set_state_nolock()) ffff9d0715e4c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787787471.505862:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0afca4d-e329-45bc-884c-b1ba8eafd358+6:2341:x1874630678783616:12345-192.168.206.10@tcp:38:mount.lustre.0 Request processed in 64700us (65147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787471.505876:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:3.0:1787787471.508268:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787471.508407:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787471.508721:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678783744 00000100:00100000:0.0:1787787471.508732:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678783744 00000100:00100000:1.0:1787787471.508778:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678783872 00000100:00100000:1.0:1787787471.508782:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678783872 00000100:00100000:1.0:1787787471.508950:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:1.0:1787787471.508963:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705977c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+7:13758:x1874630678783872:12345-192.168.206.10@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787787471.509014:0:15164:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787787471.509112:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705977c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+7:13758:x1874630678783872:12345-192.168.206.10@tcp:41:mount.lustre.0 Request processed in 153us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787471.509120:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:1.0:1787787471.509253:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:1.0:1787787471.509260:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705976d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+6:0:x1874630678783744:12345-192.168.206.10@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787787471.509274:0:14460:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787787471.509303:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705976d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+6:0:x1874630678783744:12345-192.168.206.10@tcp:41:mount.lustre.0 Request processed in 43us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787471.509323:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00080000:2.0:1787787471.511160:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787787471.513912:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787471.514145:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678784000 00000100:00100000:3.0:1787787471.514159:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678784000 00000100:00100000:3.0:1787787471.514234:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:3.0:1787787471.514246:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+6:13758:x1874630678784000:12345-192.168.206.10@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787787471.514431:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+6:13758:x1874630678784000:12345-192.168.206.10@tcp:40:mount.lustre.0 Request processed in 187us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787471.514484:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:0.0:1787787471.519338:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787471.519478:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678784128 00000100:00100000:2.0:1787787471.519492:0:15143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678784128 00000100:00100000:2.0:1787787471.519541:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:2.0:1787787471.519552:0:15143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e48b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2341:x1874630678784128:12345-192.168.206.10@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787787471.519604:0:15143:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from e0afca4d-e329-45bc-884c-b1ba8eafd358@192.168.206.10@tcp t0 exp 0000000000000000 cur 383 last 0 00000020:00000080:2.0:1787787471.519645:0:15143:0:(genops.c:1385:class_connect()) connect: client e0afca4d-e329-45bc-884c-b1ba8eafd358, cookie 0xdeb1953cba4b245e 00002000:00100000:2.0:1787787471.519729:0:15143:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e0afca4d-e329-45bc-884c-b1ba8eafd358/ffff9d0602997000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113934 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787787471.519744:0:15143:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787787471.520194:0:15143:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787787471.520250:0:15143:0:(import.c:65:import_set_state_nolock()) ffff9d0602994000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787471.520342:0:15143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e48b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+6:2341:x1874630678784128:12345-192.168.206.10@tcp:8:mount.lustre.0 Request processed in 790us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787471.520352:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:1.0:1787787471.521636:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787471.522014:0:15989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678784256 00000100:00100000:3.0:1787787471.522025:0:15989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678784256 00000100:00100000:3.0:1787787471.522081:0:15989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:3.0:1787787471.522091:0:15989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2341:x1874630678784256:12345-192.168.206.10@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787787471.522128:0:15989:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from e0afca4d-e329-45bc-884c-b1ba8eafd358@192.168.206.10@tcp t0 exp 0000000000000000 cur 383 last 0 00000020:00000080:3.0:1787787471.522183:0:15989:0:(genops.c:1385:class_connect()) connect: client e0afca4d-e329-45bc-884c-b1ba8eafd358, cookie 0xdeb1953cba4b2465 00002000:00100000:3.0:1787787471.522196:0:15989:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e0afca4d-e329-45bc-884c-b1ba8eafd358/ffff9d073faeb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113934 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787787471.522207:0:15989:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1787787471.524190:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00002000:00080000:1.0:1787787471.524325:0:15989:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787787471.524390:0:15989:0:(import.c:65:import_set_state_nolock()) ffff9d072773d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787787471.524523:0:15989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+6:2341:x1874630678784256:12345-192.168.206.10@tcp:8:mount.lustre.0 Request processed in 2431us (2892us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787471.524536:0:15989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:3.0:1787787471.524911:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678784384 00000100:00100000:3.0:1787787471.524934:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678784384 00000100:00100000:3.0:1787787471.524992:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:3.0:1787787471.525003:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+6:13758:x1874630678784384:12345-192.168.206.10@tcp:33:mount.lustre.0 00000004:00080000:1.0:1787787471.531431:0:14463:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 6347us 00000004:00200000:1.0:1787787471.547843:0:14463:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787787471.548076:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+6:13758:x1874630678784384:12345-192.168.206.10@tcp:33:mount.lustre.0 Request processed in 23067us (23888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787471.548095:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:0.0:1787787471.713910:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787471.714115:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678784512 00000100:00100000:1.0:1787787471.714129:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678784512 00000100:00100000:1.0:1787787471.714203:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:1.0:1787787471.714216:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0afca4d-e329-45bc-884c-b1ba8eafd358+6:13801:x1874630678784512:12345-192.168.206.10@tcp:101:mkdir.0 00010000:00010000:1.0:1787787471.714242:0:14462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787471.714276:0:14462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a400/0xdeb1953cba4b246c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35492 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787471.714372:0:14462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ae00/0xdeb1953cba4b2473 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787471.714390:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ae00/0xdeb1953cba4b2473 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787471.714409:0:14462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ae00/0xdeb1953cba4b2473 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787471.714698:0:14462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787787471.714704:0:14462:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787787471.714826:0:14462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ae00/0xdeb1953cba4b2473 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787471.714869:0:14462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a400/0xdeb1953cba4b246c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35492 expref: 8 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787471.714890:0:14462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ae00/0xdeb1953cba4b2473 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35492 expref: 7 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787471.714901:0:14462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d07114ac000) 00010000:00010000:1.0:1787787471.714904:0:14462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787787471.714908:0:14462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d072212ae00, rc 0) 00000100:00100000:1.0:1787787471.715004:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0afca4d-e329-45bc-884c-b1ba8eafd358+7:13801:x1874630678784512:12345-192.168.206.10@tcp:101:mkdir.0 Request processed in 790us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787471.715013:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 8 00000001:00100000:3.0:1787787472.327794:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e0afca4d-e329-45bc-884c-b1ba8eafd358 00010000:00010000:0.0:1787787472.444906:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787473.477086:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787787473.725320:0:14492:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787787473.808660:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787473.808828:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678784640 00000100:00100000:3.0:1787787473.808842:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678784640 00000100:00080000:2.0:1787787473.808988:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787473.811131:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:3.0:1787787473.811154:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+7:13853:x1874630678784640:12345-192.168.206.10@tcp:41:lfs.0 00000004:00000024:3.0:1787787473.811211:0:15164:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787787473.811350:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+7:13853:x1874630678784640:12345-192.168.206.10@tcp:41:lfs.0 Request processed in 204us (2699us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787473.811433:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:1.0:1787787473.815874:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787473.815965:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678784768 00000100:00100000:3.0:1787787473.815979:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678784768 00000100:00100000:3.0:1787787473.816123:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:3.0:1787787473.816136:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e0afca4d-e329-45bc-884c-b1ba8eafd358+5:13853:x1874630678784768:12345-192.168.206.10@tcp:13:lfs.0 00002000:00000024:3.0:1787787473.816190:0:15145:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787787473.816306:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e0afca4d-e329-45bc-884c-b1ba8eafd358+5:13853:x1874630678784768:12345-192.168.206.10@tcp:13:lfs.0 Request processed in 174us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787473.816316:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00080000:0.0:1787787473.817001:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787473.821980:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787473.822034:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678784896 00000100:00100000:1.0:1787787473.822046:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678784896 00000100:00100000:1.0:1787787473.822123:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:1.0:1787787473.822135:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e0afca4d-e329-45bc-884c-b1ba8eafd358+6:13853:x1874630678784896:12345-192.168.206.10@tcp:13:lfs.0 00002000:00000024:1.0:1787787473.822183:0:15146:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787787473.822540:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e0afca4d-e329-45bc-884c-b1ba8eafd358+6:13853:x1874630678784896:12345-192.168.206.10@tcp:13:lfs.0 Request processed in 405us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787473.822549:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00080000:1.0:1787787473.822589:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1787787473.852996:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e0afca4d-e329-45bc-884c-b1ba8eafd358 00000100:00100000:3.0:1787787474.064615:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787474.064825:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678785024 00000100:00100000:2.0:1787787474.064835:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678785024 00000100:00100000:2.0:1787787474.064952:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 89 00000100:00100000:2.0:1787787474.064963:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07346cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c13b403-cfe9-4f44-8f22-4e16a974f4be+10:13887:x1874630678785024:12345-192.168.206.10@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787787474.064980:0:14454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787474.064997:0:14454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0701647400/0xdeb1953cba4b247a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35499 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787474.065024:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0701647400/0xdeb1953cba4b247a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35499 expref: 11 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787474.065035:0:14454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0701647400/0xdeb1953cba4b247a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35499 expref: 11 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787474.065044:0:14454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0701647400, rc 0) 00000100:00100000:2.0:1787787474.065106:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07346cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c13b403-cfe9-4f44-8f22-4e16a974f4be+11:13887:x1874630678785024:12345-192.168.206.10@tcp:101:mount.lustre.0 Request processed in 145us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787474.065113:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 89 00000100:00100000:2.0:1787787474.076266:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787474.076521:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678785152 00000100:00100000:0.0:1787787474.076533:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678785152 00000100:00100000:0.0:1787787474.076603:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 90 00000100:00100000:0.0:1787787474.076616:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072d8cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c13b403-cfe9-4f44-8f22-4e16a974f4be+11:13887:x1874630678785152:12345-192.168.206.10@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787787474.077013:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072d8cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c13b403-cfe9-4f44-8f22-4e16a974f4be+11:13887:x1874630678785152:12345-192.168.206.10@tcp:501:mount.lustre.0 Request processed in 398us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787474.077023:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 90 00000100:00100000:0.0:1787787474.082411:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787474.082681:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678785280 00000100:00100000:2.0:1787787474.082693:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678785280 00000100:00100000:2.0:1787787474.082776:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 91 00000100:00100000:2.0:1787787474.082787:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072d8cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c13b403-cfe9-4f44-8f22-4e16a974f4be+11:13887:x1874630678785280:12345-192.168.206.10@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787787474.083132:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072d8cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c13b403-cfe9-4f44-8f22-4e16a974f4be+11:13887:x1874630678785280:12345-192.168.206.10@tcp:503:mount.lustre.0 Request processed in 344us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787474.083143:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 91 00000100:00100000:3.0:1787787474.088157:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787474.088893:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678785408 00000100:00100000:1.0:1787787474.088934:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678785408 00000100:00100000:1.0:1787787474.089006:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 92 00000100:00100000:1.0:1787787474.089017:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072d8cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c13b403-cfe9-4f44-8f22-4e16a974f4be+11:13893:x1874630678785408:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787787474.089410:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072d8cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c13b403-cfe9-4f44-8f22-4e16a974f4be+11:13893:x1874630678785408:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 394us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787474.089421:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 92 00000100:00100000:1.0:1787787474.103171:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787474.104130:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678785536 00000100:00100000:0.0:1787787474.104145:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678785536 00000100:00100000:0.0:1787787474.104233:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 93 00000100:00100000:0.0:1787787474.104245:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072d8ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c13b403-cfe9-4f44-8f22-4e16a974f4be+11:13893:x1874630678785536:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787787474.104836:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072d8ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c13b403-cfe9-4f44-8f22-4e16a974f4be+11:13893:x1874630678785536:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 589us (1674us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787474.104854:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 93 00000100:00100000:0.0:1787787474.115253:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787474.115499:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678785664 00000100:00100000:2.0:1787787474.115512:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678785664 00000100:00100000:0.0:1787787474.115645:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 94 00000100:00100000:0.0:1787787474.115661:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072d8cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c13b403-cfe9-4f44-8f22-4e16a974f4be+11:13887:x1874630678785664:12345-192.168.206.10@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787787474.115684:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787474.115708:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d060273dc00/0xdeb1953cba4b2481 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c354c3 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787474.115754:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d060273dc00/0xdeb1953cba4b2481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c354c3 expref: 12 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787474.115766:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d060273dc00/0xdeb1953cba4b2481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c354c3 expref: 12 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787474.115776:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d060273dc00, rc 0) 00000100:00100000:0.0:1787787474.115863:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072d8cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c13b403-cfe9-4f44-8f22-4e16a974f4be+12:13887:x1874630678785664:12345-192.168.206.10@tcp:101:mount.lustre.0 Request processed in 208us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787474.115871:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 94 00000100:00100000:3.0:1787787474.128427:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787474.129717:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678785792 00000100:00100000:1.0:1787787474.129734:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678785792 00000100:00100000:1.0:1787787474.129816:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 95 00000100:00100000:1.0:1787787474.129827:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072d8cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c13b403-cfe9-4f44-8f22-4e16a974f4be+12:13887:x1874630678785792:12345-192.168.206.10@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787787474.129860:0:14453:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787787474.129888:0:14453:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787787474.129893:0:14453:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787787474.129896:0:14453:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787787474.129898:0:14453:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787787474.137627:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072d8cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c13b403-cfe9-4f44-8f22-4e16a974f4be+12:13887:x1874630678785792:12345-192.168.206.10@tcp:256:mount.lustre.0 Request processed in 7785us (9197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787474.137646:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 95 00000100:00100000:0.0:1787787474.141345:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787474.141657:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678785920 00000100:00100000:1.0:1787787474.141669:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678785920 00000100:00100000:1.0:1787787474.141821:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 96 00000100:00100000:1.0:1787787474.141843:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072d8cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c13b403-cfe9-4f44-8f22-4e16a974f4be+12:13887:x1874630678785920:12345-192.168.206.10@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787787474.141867:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787474.141890:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d072212b200/0xdeb1953cba4b2488 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c354ca expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787474.141936:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d072212b200/0xdeb1953cba4b2488 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c354ca expref: 13 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787474.141948:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d072212b200/0xdeb1953cba4b2488 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c354ca expref: 13 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787474.141975:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d072212b200, rc 0) 00000100:00100000:1.0:1787787474.142052:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072d8cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c13b403-cfe9-4f44-8f22-4e16a974f4be+13:13887:x1874630678785920:12345-192.168.206.10@tcp:101:mount.lustre.0 Request processed in 221us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787474.142059:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 96 00000100:00100000:3.0:1787787474.145007:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787474.145186:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678786048 00000100:00100000:0.0:1787787474.145198:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678786048 00000100:00100000:0.0:1787787474.145267:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 97 00000100:00100000:0.0:1787787474.145278:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072d8cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c13b403-cfe9-4f44-8f22-4e16a974f4be+13:13887:x1874630678786048:12345-192.168.206.10@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787787474.145737:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072d8cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c13b403-cfe9-4f44-8f22-4e16a974f4be+13:13887:x1874630678786048:12345-192.168.206.10@tcp:501:mount.lustre.0 Request processed in 456us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787474.145747:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 97 00000100:00100000:3.0:1787787474.148664:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787474.148807:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678786176 00000100:00100000:1.0:1787787474.148820:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678786176 00000100:00100000:1.0:1787787474.148998:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 98 00000100:00100000:1.0:1787787474.149009:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072d8ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c13b403-cfe9-4f44-8f22-4e16a974f4be+13:13887:x1874630678786176:12345-192.168.206.10@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787787474.149325:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072d8ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c13b403-cfe9-4f44-8f22-4e16a974f4be+13:13887:x1874630678786176:12345-192.168.206.10@tcp:503:mount.lustre.0 Request processed in 317us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787474.149334:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 98 00000100:00100000:1.0:1787787474.153349:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787474.153567:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678786304 00000100:00100000:2.0:1787787474.153580:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678786304 00000100:00100000:2.0:1787787474.153651:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 99 00000100:00100000:2.0:1787787474.153663:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072d8cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c13b403-cfe9-4f44-8f22-4e16a974f4be+13:13895:x1874630678786304:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787787474.154209:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072d8cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c13b403-cfe9-4f44-8f22-4e16a974f4be+13:13895:x1874630678786304:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 547us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787474.154219:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 99 00000100:00100000:0.0:1787787474.161844:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787474.165519:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678786432 00000100:00100000:1.0:1787787474.165539:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678786432 00000100:00100000:1.0:1787787474.165632:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 100 00000100:00100000:1.0:1787787474.165644:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072d8cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c13b403-cfe9-4f44-8f22-4e16a974f4be+13:13895:x1874630678786432:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787787474.166011:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072d8cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c13b403-cfe9-4f44-8f22-4e16a974f4be+13:13895:x1874630678786432:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 367us (4182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787474.166021:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 100 00000100:00100000:3.0:1787787474.177148:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787474.177580:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678786560 00000100:00100000:1.0:1787787474.177594:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678786560 00000100:00100000:1.0:1787787474.177657:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:1.0:1787787474.177667:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705976940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2341:x1874630678786560:12345-192.168.206.10@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787787474.177705:0:14462:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 03f96fcc-4037-472b-8e81-03f071a5e665@192.168.206.10@tcp t0 exp 0000000000000000 cur 386 last 0 00000020:00000080:1.0:1787787474.177783:0:14462:0:(genops.c:1385:class_connect()) connect: client 03f96fcc-4037-472b-8e81-03f071a5e665, cookie 0xdeb1953cba4b248f 00000004:00100000:1.0:1787787474.177823:0:14462:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787787474.178091:0:14462:0:(import.c:65:import_set_state_nolock()) ffff9d072dfc6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787787474.178763:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705976940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03f96fcc-4037-472b-8e81-03f071a5e665+6:2341:x1874630678786560:12345-192.168.206.10@tcp:38:mount.lustre.0 Request processed in 1091us (1624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787474.178774:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:2.0:1787787474.192145:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787474.192192:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787474.192281:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678786816 00000100:00100000:0.0:1787787474.192301:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678786816 00000100:00100000:0.0:1787787474.192384:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678786688 00000100:00100000:0.0:1787787474.192387:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678786688 00000100:00100000:0.0:1787787474.192416:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:0.0:1787787474.192425:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03f96fcc-4037-472b-8e81-03f071a5e665+7:13887:x1874630678786816:12345-192.168.206.10@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787787474.192495:0:14460:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787787474.192577:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03f96fcc-4037-472b-8e81-03f071a5e665+7:13887:x1874630678786816:12345-192.168.206.10@tcp:41:mount.lustre.0 Request processed in 153us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787474.192585:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:0.0:1787787474.192604:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:0.0:1787787474.192610:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03f96fcc-4037-472b-8e81-03f071a5e665+6:0:x1874630678786688:12345-192.168.206.10@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787787474.192621:0:14460:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787787474.192641:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03f96fcc-4037-472b-8e81-03f071a5e665+6:0:x1874630678786688:12345-192.168.206.10@tcp:41:mount.lustre.0 Request processed in 31us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787474.192648:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00080000:1.0:1787787474.192734:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787474.195666:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787474.195973:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678786944 00000100:00100000:1.0:1787787474.195985:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678786944 00000100:00100000:1.0:1787787474.196091:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:1.0:1787787474.196104:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03f96fcc-4037-472b-8e81-03f071a5e665+6:13887:x1874630678786944:12345-192.168.206.10@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787787474.196272:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03f96fcc-4037-472b-8e81-03f071a5e665+6:13887:x1874630678786944:12345-192.168.206.10@tcp:40:mount.lustre.0 Request processed in 171us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787474.196281:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:3.0:1787787474.198379:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787474.198424:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787474.198486:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787474.198692:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678787072 00000100:00100000:2.0:1787787474.198704:0:15143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678787072 00000100:00100000:2.0:1787787474.198750:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678787200 00000100:00100000:2.0:1787787474.198754:0:15143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678787200 00000100:00100000:2.0:1787787474.198778:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:2.0:1787787474.198786:0:15143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07059761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2341:x1874630678787072:12345-192.168.206.10@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787787474.198834:0:15143:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 03f96fcc-4037-472b-8e81-03f071a5e665@192.168.206.10@tcp t0 exp 0000000000000000 cur 386 last 0 00000020:00000080:2.0:1787787474.198873:0:15143:0:(genops.c:1385:class_connect()) connect: client 03f96fcc-4037-472b-8e81-03f071a5e665, cookie 0xdeb1953cba4b2496 00002000:00100000:2.0:1787787474.198888:0:15143:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 03f96fcc-4037-472b-8e81-03f071a5e665/ffff9d0602991800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113934 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787787474.198913:0:15143:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787787474.199232:0:15143:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787787474.199271:0:15143:0:(import.c:65:import_set_state_nolock()) ffff9d0602994800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787474.199353:0:15143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07059761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03f96fcc-4037-472b-8e81-03f071a5e665+6:2341:x1874630678787072:12345-192.168.206.10@tcp:8:mount.lustre.0 Request processed in 567us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787474.199361:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:2.0:1787787474.199383:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:2.0:1787787474.199388:0:15143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705975e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2341:x1874630678787200:12345-192.168.206.10@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787787474.199406:0:15143:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 03f96fcc-4037-472b-8e81-03f071a5e665@192.168.206.10@tcp t0 exp 0000000000000000 cur 386 last 0 00000020:00000080:2.0:1787787474.199425:0:15143:0:(genops.c:1385:class_connect()) connect: client 03f96fcc-4037-472b-8e81-03f071a5e665, cookie 0xdeb1953cba4b249d 00002000:00100000:2.0:1787787474.199432:0:15143:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 03f96fcc-4037-472b-8e81-03f071a5e665/ffff9d0602990000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113934 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787787474.199465:0:15143:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787787474.199613:0:15143:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787787474.199630:0:15143:0:(import.c:65:import_set_state_nolock()) ffff9d0602992000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787474.199667:0:15143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705975e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03f96fcc-4037-472b-8e81-03f071a5e665+6:2341:x1874630678787200:12345-192.168.206.10@tcp:8:mount.lustre.0 Request processed in 277us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787474.199674:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:1.0:1787787474.199692:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678787328 00000100:00100000:1.0:1787787474.199697:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678787328 00000100:00100000:1.0:1787787474.200044:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00100000:1.0:1787787474.200054:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705974f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03f96fcc-4037-472b-8e81-03f071a5e665+6:13887:x1874630678787328:12345-192.168.206.10@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787787474.200277:0:14464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787787474.200425:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705974f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03f96fcc-4037-472b-8e81-03f071a5e665+6:13887:x1874630678787328:12345-192.168.206.10@tcp:33:mount.lustre.0 Request processed in 373us (1938us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787474.200433:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00100000:3.0:1787787474.360704:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787474.360864:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678787456 00000100:00100000:2.0:1787787474.360878:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678787456 00000100:00100000:2.0:1787787474.360964:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:2.0:1787787474.360975:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705974b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03f96fcc-4037-472b-8e81-03f071a5e665+6:13916:x1874630678787456:12345-192.168.206.10@tcp:101:mkdir.0 00010000:00010000:2.0:1787787474.361003:0:14461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787474.361037:0:14461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701647c00/0xdeb1953cba4b24a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c354f4 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787474.361120:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701646e00/0xdeb1953cba4b24ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787474.361159:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701646e00/0xdeb1953cba4b24ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787474.361175:0:14461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701646e00/0xdeb1953cba4b24ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787474.361702:0:14461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787787474.361707:0:14461:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787787474.361967:0:14461:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701646e00/0xdeb1953cba4b24ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787474.362010:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701647c00/0xdeb1953cba4b24a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c354f4 expref: 8 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787474.362034:0:14461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701646e00/0xdeb1953cba4b24ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c354f4 expref: 7 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787474.362045:0:14461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d07114ac000) 00010000:00010000:2.0:1787787474.362048:0:14461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787787474.362053:0:14461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0701646e00, rc 0) 00000100:00100000:2.0:1787787474.362152:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705974b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03f96fcc-4037-472b-8e81-03f071a5e665+7:13916:x1874630678787456:12345-192.168.206.10@tcp:101:mkdir.0 Request processed in 1178us (1461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787474.362162:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 14 00010000:00010000:2.0:1787787474.492776:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787475.520648:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787475.836634:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787787475.836702:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787787475.836714:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d071b1de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694503936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787787475.836776:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787475.836857:0:15985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694503936 00000100:00100000:2.0:1787787475.836864:0:15985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694503936 00000100:00100000:2.0:1787787475.836930:0:15985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787787475.836940:0:15985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694503936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787787475.836974:0:15985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787475.837019:0:15985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694503936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787475.837026:0:15985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1787787475.837045:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787787475.837077:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d071b1de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694503936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787475.837211:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0702fd6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:3292:1874630694503680:0@lo:400:kworker.0 00000100:00100000:2.0:1787787475.837377:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787475.837462:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694503680 00000100:00100000:0.0:1787787475.837466:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694503680 00000100:00100000:0.0:1787787475.837500:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787787475.837524:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072d8ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+19:3292:x1874630694503680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787475.837567:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072d8ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+19:3292:x1874630694503680:12345-0@lo:400:kworker.0 Request processed in 54us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787475.837574:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787787475.837701:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0702fd6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:3292:1874630694503680:0@lo:400:kworker.0 00000100:00100000:0.0:1787787475.839269:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0702fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694504064:0@lo:400:kworker.0 00000100:00100000:0.0:1787787475.839326:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787475.839406:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694504064 00000100:00100000:2.0:1787787475.839412:0:15144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694504064 00000100:00100000:2.0:1787787475.839476:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787787475.839485:0:15144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694504064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787475.839806:0:15144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694504064:12345-0@lo:400:kworker.0 Request processed in 321us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787475.839814:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787787475.839834:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787475.839844:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0702fd5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874630694504192:0@lo:400:kworker.0 00000100:00100000:2.0:1787787475.839874:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787475.839943:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694504192 00000100:00100000:2.0:1787787475.839948:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694504192 00000100:00100000:2.0:1787787475.839975:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787787475.839982:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1874630694504192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787475.840020:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1874630694504192:12345-0@lo:400:kworker.0 Request processed in 39us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787475.840040:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787787475.840073:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0702fd5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874630694504192:0@lo:400:kworker.0 00000100:00100000:3.0:1787787475.840340:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0705975a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694503808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787787475.840464:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787475.843509:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694503808 00000100:00100000:2.0:1787787475.843533:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694503808 00000100:00100000:2.0:1787787475.843594:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787787475.843604:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705975680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694503808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787787475.843640:0:15145:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787475.843720:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705975680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874630694503808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (3255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787475.843727:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787787475.843799:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0705975a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1874630694503808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787787475.844011:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0702fd4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1874630694504448:0@lo:400:kworker.0 00000100:00100000:2.0:1787787475.844027:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0702fd7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1874630694504320:0@lo:400:kworker.0 00000100:00100000:2.0:1787787475.844052:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787475.844070:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694504320 00000100:00100000:3.0:1787787475.844074:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694504320 00000100:00080000:2.0:1787787475.844100:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787475.844113:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787787475.844120:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07222503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874630694504320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787475.844228:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787475.844233:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07222503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874630694504320:12345-0@lo:400:kworker.0 Request processed in 49us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787475.844241:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787787475.844254:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694504448 00000100:00100000:3.0:1787787475.844257:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694504448 00000100:00100000:3.0:1787787475.844286:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787787475.844292:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874630694504448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787475.844322:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874630694504448:12345-0@lo:400:kworker.0 Request processed in 31us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787475.844328:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787787475.844485:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0702fd7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1874630694504320:0@lo:400:kworker.0 00000100:00100000:1.0:1787787475.844618:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0702fd4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1874630694504448:0@lo:400:kworker.0 00000100:00100000:0.0:1787787475.849325:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0702fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694504064:0@lo:400:kworker.0 00000100:00080000:2.0:1787787475.849662:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787787476.543818:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787787476.916060:0:5842:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e0afca4d-e329-45bc-884c-b1ba8eafd358 00000001:00100000:0.0:1787787476.916073:0:5842:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 03f96fcc-4037-472b-8e81-03f071a5e665 00000001:02000400:0.0:1787787476.947007:0:16421:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1787787477.473050:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 03f96fcc-4037-472b-8e81-03f071a5e665 00010000:00010000:2.0:1787787477.569256:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787478.590270:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787787478.956269:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 03f96fcc-4037-472b-8e81-03f071a5e665 00000100:00100000:3.0:1787787479.523920:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787479.523965:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787479.523987:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787479.524013:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787479.524046:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787479.524062:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787479.524084:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787479.524115:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678787968 00000100:00100000:3.0:1787787479.524126:0:15143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678787968 00000100:00100000:0.0:1787787479.524163:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678787712 00000100:00100000:0.0:1787787479.524170:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678787712 00000100:00100000:3.0:1787787479.524193:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678788224 00000100:00100000:3.0:1787787479.524197:0:15143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678788224 00000100:00100000:0.0:1787787479.524217:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678788096 00000100:00100000:3.0:1787787479.524220:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678787840 00000100:00100000:0.0:1787787479.524223:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678788096 00000100:00100000:3.0:1787787479.524225:0:15143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678787840 00000100:00100000:3.0:1787787479.524238:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678788352 00000100:00100000:3.0:1787787479.524240:0:15143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678788352 00000100:00100000:3.0:1787787479.524255:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 3 00000100:00100000:3.0:1787787479.524265:0:15143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07059770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+5:2344:x1874630678787968:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787479.524349:0:15143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07059770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+5:2344:x1874630678787968:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 86us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787479.524357:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 3 00000100:00100000:3.0:1787787479.524374:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:3.0:1787787479.524380:0:15143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03f96fcc-4037-472b-8e81-03f071a5e665+5:2344:x1874630678788224:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787479.524403:0:15143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03f96fcc-4037-472b-8e81-03f071a5e665+5:2344:x1874630678788224:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 23us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787479.524408:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:3.0:1787787479.524418:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:3.0:1787787479.524423:0:15143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+5:2344:x1874630678787840:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787479.524498:0:15143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+5:2344:x1874630678787840:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 74us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787479.524504:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:3.0:1787787479.524515:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:3.0:1787787479.524536:0:15143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03f96fcc-4037-472b-8e81-03f071a5e665+5:2344:x1874630678788352:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787479.524557:0:15143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03f96fcc-4037-472b-8e81-03f071a5e665+5:2344:x1874630678788352:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 23us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787479.524563:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00080000:3.0:1787787479.524586:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787787479.524591:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787787479.525339:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 17 00000100:00100000:0.0:1787787479.525572:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 18 00000100:00100000:2.0:1787787479.526165:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678787584 00000100:00100000:2.0:1787787479.526178:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678787584 00000100:00100000:2.0:1787787479.526217:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 102 00000100:00100000:2.0:1787787479.526226:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072d8cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c13b403-cfe9-4f44-8f22-4e16a974f4be+13:2344:x1874630678787584:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787787479.526321:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072d8cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c13b403-cfe9-4f44-8f22-4e16a974f4be+13:2344:x1874630678787584:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 97us (2306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787479.526342:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 102 00000100:00080000:3.0:1787787479.528432:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787787479.531401:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705975a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0afca4d-e329-45bc-884c-b1ba8eafd358+6:2344:x1874630678787712:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787787479.531549:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705975a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0afca4d-e329-45bc-884c-b1ba8eafd358+6:2344:x1874630678787712:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 6186us (7644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787479.531563:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 17 00000100:00100000:0.0:1787787479.538695:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03f96fcc-4037-472b-8e81-03f071a5e665+6:2344:x1874630678788096:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787787479.538844:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03f96fcc-4037-472b-8e81-03f071a5e665+6:2344:x1874630678788096:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 13263us (14779us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787479.538857:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 18 00010000:00010000:2.0:1787787479.612797:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787787480.369677:0:16572:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffedbfc8fe0 20000000:00000080:2.0:1787787480.369701:0:16572:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d0602b24c00 uarg=0000000000000000 20000000:01000000:2.0:1787787480.369752:0:16572:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787787480.369760:0:16572:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787787480.369765:0:16572:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787787480.378413:0:16573:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1787787480.378752:0:16572:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787787480.388924:0:16572:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787787480.388968:0:16572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b24b2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787480.388993:0:16572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0708771e00/0xdeb1953cba4b21a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b21a2 expref: 18 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787480.389002:0:16572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0737a1d800/0xdeb1953cba4b21f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b21ef expref: 18 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787480.389010:0:16572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d073fd39800/0xdeb1953cba4b2266 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b225f expref: 18 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787480.389021:0:16572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d072212a600/0xdeb1953cba4b2450 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35468 expref: 12 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787480.389053:0:16572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d072212b200/0xdeb1953cba4b2488 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c354ca expref: 12 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787480.389061:0:16572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b24b2 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787480.389117:0:16572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d072212b200/0xdeb1953cba4b2488 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c354ca expref: 12 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787480.389134:0:16572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d072212b200/0xdeb1953cba4b2488 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c354ca expref: 12 pid: 14455 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787480.389154:0:16572:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07377e7c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16572:1874630694504576:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787787480.389536:0:16572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d072212a600/0xdeb1953cba4b2450 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35468 expref: 12 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787480.389545:0:16572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d072212a600/0xdeb1953cba4b2450 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35468 expref: 12 pid: 14455 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787480.389555:0:16572:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07377e7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16572:1874630694504704:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787787480.389589:0:16572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d073fd39800/0xdeb1953cba4b2266 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b225f expref: 18 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787480.390859:0:16572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d073fd39800/0xdeb1953cba4b2266 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b225f expref: 18 pid: 14455 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787480.390888:0:16572:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07377e5e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16572:1874630694504832:0@lo:104: 00000100:00100000:3.0:1787787480.390945:0:16572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787787480.391028:0:16572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0737a1d800/0xdeb1953cba4b21f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b21ef expref: 18 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787480.391037:0:16572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d0737a1d800/0xdeb1953cba4b21f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b21ef expref: 18 pid: 14455 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787480.391045:0:16572:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07377e4b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16572:1874630694504960:0@lo:104: 00000100:00100000:3.0:1787787480.391067:0:16572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787787480.391100:0:16572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0708771e00/0xdeb1953cba4b21a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdeb1953cba4b21a2 expref: 18 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787480.391108:0:16572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d0708771e00/0xdeb1953cba4b21a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdeb1953cba4b21a2 expref: 18 pid: 14455 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787480.391116:0:16572:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07377e4f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16572:1874630694505088:0@lo:104: 00000100:00100000:3.0:1787787480.391140:0:16572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787480.391151:0:16572:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0703169d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787787480.391606:0:14445:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787787480.391638:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694504832 00000100:00100000:1.0:1787787480.391646:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694504832 00000100:00100000:1.0:1787787480.391698:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694504960 00000100:00100000:1.0:1787787480.391710:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694504960 00000100:00100000:1.0:1787787480.391723:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694505088 00000100:00100000:1.0:1787787480.391726:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694505088 00000100:00100000:1.0:1787787480.391740:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787787480.391749:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+5:16572:x1874630694504832:12345-0@lo:104: 00010000:00010000:1.0:1787787480.391764:0:14445:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9d0737a1dc00/0xdeb1953cba4b225f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b2266 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787480.391840:0:14445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787787480.391847:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+5:16572:x1874630694504832:12345-0@lo:104: Request processed in 99us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787480.391855:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787787480.391864:0:14450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787787480.391885:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787787480.391892:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+4:16572:x1874630694504960:12345-0@lo:104: 00010000:00010000:1.0:1787787480.391901:0:14445:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9d0708771a00/0xdeb1953cba4b21ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b21f6 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787480.391909:0:14450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d0737a1dc00/0xdeb1953cba4b225f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b2266 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787480.391917:0:14450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1dc00 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:2.0:1787787480.391922:0:14450:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d0737a1dc00/0xdeb1953cba4b225f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b2266 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787480.391931:0:14450:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d0737a1dc00/0xdeb1953cba4b225f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b2266 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787480.391938:0:14450:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d0737a1dc00/0xdeb1953cba4b225f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b2266 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787480.391940:0:14445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:01000000:2.0:1787787480.391945:0:14450:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1787787480.391945:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+4:16572:x1874630694504960:12345-0@lo:104: Request processed in 54us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787480.391962:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787787480.391982:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1787787480.391983:0:14450:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d0737a1dc00/0xdeb1953cba4b225f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b2266 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787480.391988:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072daa7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+3:16572:x1874630694505088:12345-0@lo:104: 00010000:00010000:2.0:1787787480.391990:0:14450:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787480.391995:0:14445:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d200/0xdeb1953cba4b21a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b21a9 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787480.392012:0:14450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d0737a1dc00/0xdeb1953cba4b225f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b2266 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787480.392021:0:14445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787787480.392026:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072daa7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+3:16572:x1874630694505088:12345-0@lo:104: Request processed in 39us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787480.392031:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1787787480.392042:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d0737a1dc00/0xdeb1953cba4b225f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b2266 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787480.392056:0:14450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787787480.392059:0:14450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d0708771a00/0xdeb1953cba4b21ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b21f6 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787480.392065:0:14450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708771a00 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:2.0:1787787480.392068:0:14450:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d0708771a00/0xdeb1953cba4b21ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b21f6 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787480.392069:0:14449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787480.392075:0:14450:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d0708771a00/0xdeb1953cba4b21ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b21f6 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787480.392092:0:14450:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d0708771a00/0xdeb1953cba4b21ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b21f6 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787480.392097:0:14450:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787787480.392116:0:14450:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d0708771a00/0xdeb1953cba4b21ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b21f6 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787480.392122:0:14450:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787480.392128:0:14450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d0708771a00/0xdeb1953cba4b21ef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b21f6 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787480.392133:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d0708771a00/0xdeb1953cba4b21ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b21f6 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787480.392143:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787480.392149:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787480.392151:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787480.392172:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0722252d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:3291:1874630694505216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787480.392206:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787480.392242:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1787787480.392244:0:16574:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787480.392248:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07222512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:3291:1874630694505344:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787787480.392250:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d200/0xdeb1953cba4b21a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdeb1953cba4b21a9 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787480.392256:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0737a1d200 already unused, calling callback (ffffffffc1a9fc20) 10000000:00010000:1.0:1787787480.392259:0:14449:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d200/0xdeb1953cba4b21a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdeb1953cba4b21a9 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787480.392267:0:14449:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d200/0xdeb1953cba4b21a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdeb1953cba4b21a9 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787480.392269:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1787787480.392274:0:14449:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d200/0xdeb1953cba4b21a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdeb1953cba4b21a9 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787480.392279:0:14449:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787787480.392297:0:14449:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d200/0xdeb1953cba4b21a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b21a9 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787480.392305:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694505216 00000100:00100000:2.0:1787787480.392309:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694505216 00010000:00010000:1.0:1787787480.392313:0:14449:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787480.392328:0:14446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d073fd39800/0xdeb1953cba4b2266 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b225f expref: 19 pid: 14455 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787480.392330:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d200/0xdeb1953cba4b21a2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b21a9 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787480.392337:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9d0737a1d200/0xdeb1953cba4b21a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdeb1953cba4b21a9 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787480.392348:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694505344 00000100:00100000:2.0:1787787480.392351:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694505344 00010000:00010000:1.0:1787787480.392351:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787480.392353:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787480.392355:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787480.392360:0:14446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0737a1d800/0xdeb1953cba4b21f6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b21ef expref: 20 pid: 14455 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787480.392361:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787787480.392370:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0702fd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:3294:1874630694505472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787480.392371:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787787480.392377:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0722251e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+20:3291:x1874630694505216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787787480.392388:0:14446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787480.392394:0:14446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d073fd39800/0xdeb1953cba4b2266 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b225f expref: 20 pid: 14455 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787480.392397:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787787480.392404:0:14446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d073fd39800/0xdeb1953cba4b2266 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b225f expref: 20 pid: 14455 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787480.392412:0:16574:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787480.392413:0:16574:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787480.392423:0:14446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787480.392487:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0722251e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+20:3291:x1874630694505216:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787480.392494:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787787480.392513:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694505472 00010000:00010000:3.0:1787787480.392533:0:16572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d073fd39800/0xdeb1953cba4b2266 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b225f expref: 19 pid: 14455 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787480.392545:0:16572:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07377e5e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16572:1874630694504832:0@lo:104: 00000100:00100000:3.0:1787787480.392555:0:16572:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07377e4b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16572:1874630694504960:0@lo:104: 00000100:00100000:3.0:1787787480.392563:0:16572:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07377e4f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16572:1874630694505088:0@lo:104: 00000100:00100000:3.0:1787787480.392607:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787787480.392616:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0722250b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+18:3291:x1874630694505344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787787480.392625:0:14447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787480.392630:0:14447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0737a1d800/0xdeb1953cba4b21f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b21ef expref: 18 pid: 14455 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787480.392649:0:14447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0737a1d800/0xdeb1953cba4b21f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b21ef expref: 18 pid: 14455 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787480.392660:0:14447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0737a1d800/0xdeb1953cba4b21f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b21ef expref: 18 pid: 14455 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787480.392668:0:14447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787480.392697:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0722250b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+17:3291:x1874630694505344:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787480.392704:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787787480.392716:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694505472 00010000:00010000:2.0:1787787480.392733:0:14446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0708771e00/0xdeb1953cba4b21a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b21a2 expref: 17 pid: 14455 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787480.392753:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787787480.393019:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07222512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:3291:1874630694505344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787787480.393029:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0722252d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:3291:1874630694505216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787787480.393107:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0704fd9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+17:3294:x1874630694505472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787787480.393117:0:14446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787480.393123:0:14446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0708771e00/0xdeb1953cba4b21a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdeb1953cba4b21a2 expref: 17 pid: 14455 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787480.393131:0:14446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0708771e00/0xdeb1953cba4b21a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdeb1953cba4b21a2 expref: 17 pid: 14455 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787480.393143:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0708771e00/0xdeb1953cba4b21a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdeb1953cba4b21a2 expref: 17 pid: 14455 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787480.393152:0:14446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787480.393200:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0704fd9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+16:3294:x1874630694505472:12345-0@lo:103:ldlm_bl.0 Request processed in 441us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787480.393206:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787787480.395829:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0702fd5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:3294:1874630694505472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787480.396983:0:16572:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07377e7c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16572:1874630694504576:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787787480.396998:0:16572:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07377e7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16572:1874630694504704:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787787480.397035:0:16572:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b24b2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787480.399532:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787480.399623:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787480.399690:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678788608 00000100:00100000:0.0:1787787480.399704:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678788608 00010000:00010000:0.0:1787787480.399751:0:14447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d072212a600/0xdeb1953cba4b2450 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35468 expref: 13 pid: 14455 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787480.399790:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678788480 00000100:00100000:0.0:1787787480.399805:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678788480 00010000:00010000:0.0:1787787480.399822:0:14447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d072212b200/0xdeb1953cba4b2488 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c354ca expref: 14 pid: 14455 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787480.399840:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:0.0:1787787480.399850:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0722251680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c13b403-cfe9-4f44-8f22-4e16a974f4be+14:2345:x1874630678788608:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787480.399867:0:14447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787480.399884:0:14447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d072212a600/0xdeb1953cba4b2450 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35468 expref: 14 pid: 14455 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787480.399898:0:14447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d072212a600/0xdeb1953cba4b2450 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35468 expref: 14 pid: 14455 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787480.399921:0:14447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d072212a600/0xdeb1953cba4b2450 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35468 expref: 14 pid: 14455 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787480.399941:0:14447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787480.400011:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0722251680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c13b403-cfe9-4f44-8f22-4e16a974f4be+13:2345:x1874630678788608:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 162us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787480.400020:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:0.0:1787787480.400040:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:0.0:1787787480.400047:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0722250000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c13b403-cfe9-4f44-8f22-4e16a974f4be+12:2345:x1874630678788480:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787480.400056:0:14447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787480.400061:0:14447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d072212b200/0xdeb1953cba4b2488 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c354ca expref: 12 pid: 14455 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787480.400071:0:14447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d072212b200/0xdeb1953cba4b2488 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c354ca expref: 12 pid: 14455 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787480.400095:0:14447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d072212b200/0xdeb1953cba4b2488 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c354ca expref: 12 pid: 14455 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787480.400108:0:14447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b24b2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787480.400117:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b24b2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787480.400137:0:14447:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b24b2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787480.400144:0:14447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b24b2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787480.400152:0:14447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b24b2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787480.400160:0:14447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b24b2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787480.400167:0:14447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708770800 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:0.0:1787787480.400171:0:14447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b24b2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787480.400181:0:14447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b24b2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787480.400194:0:14447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b24b2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787480.400217:0:14447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787480.400254:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0722250000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c13b403-cfe9-4f44-8f22-4e16a974f4be+11:2345:x1874630678788480:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 207us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787480.400262:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 8 00010000:00010000:2.0:1787787480.401047:0:16572:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b24b2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787480.401061:0:16572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b24b2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787480.401069:0:16572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0708770800/0xdeb1953cba4b24b2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787480.650560:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787480.957704:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787787480.957726:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0722252940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694505600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787787480.957790:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787480.957861:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787787480.957887:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07377e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694505728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787787480.957912:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787480.957944:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694505600 00000100:00100000:3.0:1787787480.957951:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694505600 00000100:00100000:3.0:1787787480.958000:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694505728 00000100:00100000:3.0:1787787480.958003:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694505728 00000100:00100000:3.0:1787787480.958022:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787787480.958032:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694505600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787787480.958066:0:15146:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787787480.958116:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694505600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787480.958123:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787787480.958138:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787787480.958144:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694505728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787787480.958162:0:15146:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787787480.958194:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694505728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787480.958201:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1787787480.958220:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787787480.958223:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787787480.958465:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0722252940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694505600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787787480.958585:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07377e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694505728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787480.958778:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0722251e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1874630694506240:0@lo:400:kworker.0 00000100:00100000:2.0:1787787480.958814:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787480.958837:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787787480.958852:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0722252940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:3291:1874630694505856:0@lo:400:kworker.0 00000100:00100000:1.0:1787787480.959023:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07222521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1874630694506112:0@lo:400:kworker.0 00000100:00100000:1.0:1787787480.959051:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787480.959072:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787787480.959077:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0722250780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874630694505984:0@lo:400:kworker.0 00000100:00100000:1.0:1787787480.959097:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787480.959122:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694506240 00000100:00100000:1.0:1787787480.959126:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694506240 00000100:00100000:1.0:1787787480.959160:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694506112 00000100:00100000:1.0:1787787480.959163:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694506112 00000100:00100000:1.0:1787787480.959189:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694505984 00000100:00100000:1.0:1787787480.959192:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694505984 00000100:00100000:1.0:1787787480.959204:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787787480.959210:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0722250b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1874630694506240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787480.959245:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0722250b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1874630694506240:12345-0@lo:400:kworker.0 Request processed in 35us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787480.959332:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787480.959369:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0722251e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1874630694506240:0@lo:400:kworker.0 00000100:00100000:3.0:1787787480.959496:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694505856 00000100:00100000:3.0:1787787480.959501:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694505856 00000100:00100000:3.0:1787787480.959630:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787787480.959637:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d072d8cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+16:3291:x1874630694505856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787480.959675:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d072d8cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+16:3291:x1874630694505856:12345-0@lo:400:kworker.0 Request processed in 39us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787480.959687:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787787480.961794:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787787480.961920:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0722252940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:3291:1874630694505856:0@lo:400:kworker.0 00000100:00100000:2.0:1787787480.966129:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787787480.966433:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787787480.966461:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874630694505984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787480.966619:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874630694505984:12345-0@lo:400:kworker.0 Request processed in 167us (7520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787480.966627:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1787787480.966666:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787480.967432:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0722250780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874630694505984:0@lo:400:kworker.0 00000100:00100000:3.0:1787787480.968050:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1874630694506112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787480.968125:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1874630694506112:12345-0@lo:400:kworker.0 Request processed in 1984us (9073us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787480.968134:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787787480.968231:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07222521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1874630694506112:0@lo:400:kworker.0 00000100:00100000:3.0:1787787481.443632:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787481.443711:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678788736 00000100:00100000:2.0:1787787481.443719:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678788736 00000100:00100000:2.0:1787787481.443763:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 104 00000100:00100000:2.0:1787787481.443771:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c13b403-cfe9-4f44-8f22-4e16a974f4be+11:13772:x1874630678788736:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787481.443784:0:14454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787481.443798:0:14454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0701647200/0xdeb1953cba4b24b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c354fb expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787481.443819:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0701647200/0xdeb1953cba4b24b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c354fb expref: 12 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787481.443827:0:14454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0701647200/0xdeb1953cba4b24b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c354fb expref: 12 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787481.443834:0:14454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0701647200, rc 0) 00000100:00100000:2.0:1787787481.443891:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c13b403-cfe9-4f44-8f22-4e16a974f4be+12:13772:x1874630678788736:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 Request processed in 120us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787481.443898:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 104 00000100:00100000:2.0:1787787481.446035:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787481.446098:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678788864 00000100:00100000:3.0:1787787481.446107:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678788864 00000100:00100000:3.0:1787787481.446157:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 105 00000100:00100000:3.0:1787787481.446168:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c13b403-cfe9-4f44-8f22-4e16a974f4be+12:13772:x1874630678788864:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787481.446675:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c13b403-cfe9-4f44-8f22-4e16a974f4be+12:13772:x1874630678788864:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 Request processed in 508us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787481.446683:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 105 00000100:00100000:3.0:1787787481.452986:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787481.453023:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678788992 00000100:00100000:3.0:1787787481.453033:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678788992 00000100:00100000:3.0:1787787481.453079:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 106 00000100:00100000:3.0:1787787481.453088:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c13b403-cfe9-4f44-8f22-4e16a974f4be+12:13772:x1874630678788992:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787787481.453324:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c13b403-cfe9-4f44-8f22-4e16a974f4be+12:13772:x1874630678788992:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 Request processed in 236us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787481.453333:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 106 00000100:00100000:2.0:1787787481.465269:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787481.469972:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678789120 00000100:00100000:3.0:1787787481.469987:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678789120 00000100:00100000:3.0:1787787481.470047:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 107 00000100:00100000:3.0:1787787481.470055:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c13b403-cfe9-4f44-8f22-4e16a974f4be+12:13772:x1874630678789120:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787787481.470071:0:14453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787481.470087:0:14453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0708771e00/0xdeb1953cba4b24c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35502 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787481.470112:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0708771e00/0xdeb1953cba4b24c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35502 expref: 13 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787481.470123:0:14453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0708771e00/0xdeb1953cba4b24c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35502 expref: 13 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787481.470132:0:14453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708771e00, rc 0) 00000100:00100000:3.0:1787787481.470186:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c13b403-cfe9-4f44-8f22-4e16a974f4be+13:13772:x1874630678789120:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 Request processed in 131us (4924us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787481.470194:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 107 00000100:00100000:3.0:1787787481.480504:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787481.480586:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678789248 00000100:00100000:2.0:1787787481.480596:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678789248 00000100:00100000:2.0:1787787481.480645:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 108 00000100:00100000:2.0:1787787481.480654:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c13b403-cfe9-4f44-8f22-4e16a974f4be+13:13772:x1874630678789248:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787481.480926:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c13b403-cfe9-4f44-8f22-4e16a974f4be+13:13772:x1874630678789248:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 Request processed in 272us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787481.480934:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 108 00000100:00100000:3.0:1787787481.485770:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787481.486588:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678789376 00000100:00100000:1.0:1787787481.486598:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678789376 00000100:00100000:1.0:1787787481.486654:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 109 00000100:00100000:1.0:1787787481.486664:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c13b403-cfe9-4f44-8f22-4e16a974f4be+13:13772:x1874630678789376:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787481.486880:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c13b403-cfe9-4f44-8f22-4e16a974f4be+13:13772:x1874630678789376:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 Request processed in 218us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787481.486888:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 109 00010000:00010000:3.0:1787787481.662181:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787787482.237883:0:14458:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787787482.237889:0:14458:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d073c771800 from 10 10000000:01000000:3.0:1787787482.237894:0:14458:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787787482.237986:0:14458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0708770200/0xdeb1953cba4b24c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787482.237998:0:14458:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d0708770200/0xdeb1953cba4b24c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787482.238010:0:14458:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d0708770200/0xdeb1953cba4b24c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787482.238041:0:14458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07377e5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694506368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787787482.238100:0:14458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787482.238154:0:14458:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0703169d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787787482.238236:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694506368 00000100:00100000:0.0:1787787482.238242:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694506368 00000100:00100000:0.0:1787787482.238289:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787787482.238299:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+16:14458:x1874630694506368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787482.238311:0:14453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787482.238323:0:14453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d060273de00/0xdeb1953cba4b24ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b24c7 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787482.238344:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d060273de00/0xdeb1953cba4b24ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b24c7 expref: 17 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787482.238355:0:14453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d060273de00/0xdeb1953cba4b24ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b24c7 expref: 17 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787482.238364:0:14453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d060273de00, rc 0) 00000100:00100000:0.0:1787787482.238415:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+17:14458:x1874630694506368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787482.238422:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787787482.238554:0:14458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07377e5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694506368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787787482.238567:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d0708770200/0xdeb1953cba4b24c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b24ce expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787482.238576:0:14458:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d0708770200/0xdeb1953cba4b24c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b24ce expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787482.238694:0:14458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07377e5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694506496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787482.238721:0:14458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787482.239008:0:14458:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0703169d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787787482.241159:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694506496 00000100:00100000:0.0:1787787482.241173:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694506496 00000100:00100000:0.0:1787787482.241233:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787787482.241242:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+17:14458:x1874630694506496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787482.248738:0:14458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07377e5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694506496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787482.248795:0:14458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e4b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694506624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787482.249460:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+17:14458:x1874630694506496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 8216us (10735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787482.249472:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787787482.250122:0:14458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787482.250181:0:14458:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07059c5540 going to sleep for 11 seconds 00000100:00100000:2.0:1787787482.250689:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694506624 00000100:00100000:2.0:1787787482.250698:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694506624 00000100:00100000:2.0:1787787482.250747:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787787482.250756:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+17:14458:x1874630694506624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787482.255285:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+17:14458:x1874630694506624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4521us (5156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787482.255301:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787787482.255780:0:14458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e4b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694506624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787787482.261085:0:16676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787787482.261331:0:14458:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787787482.261352:0:14458:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787787482.261373:0:14458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0708770200/0xdeb1953cba4b24c7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b24ce expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787482.261387:0:14458:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d0708770200/0xdeb1953cba4b24c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b24ce expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787482.261397:0:14458:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787787482.261400:0:14458:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d07055ed000 from 10 10000000:01000000:2.0:1787787482.261403:0:14458:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787787482.261470:0:14458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0701646800/0xdeb1953cba4b24d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787482.261492:0:14458:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d0701646800/0xdeb1953cba4b24d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787482.261504:0:14458:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d0701646800/0xdeb1953cba4b24d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787482.261529:0:14458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0722250780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694506752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787787482.261594:0:14458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787482.262389:0:14458:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0704e2f000 going to sleep for 11 seconds 00000100:00100000:0.0:1787787482.265708:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694506752 00000100:00100000:0.0:1787787482.265724:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694506752 00000100:00100000:0.0:1787787482.265781:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787787482.265794:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073ff7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+17:14458:x1874630694506752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787482.265810:0:14454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787482.265826:0:14454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d060273ce00/0xdeb1953cba4b24dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b24d5 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787482.265852:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d060273ce00/0xdeb1953cba4b24dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b24d5 expref: 18 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787482.265876:0:14454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d060273ce00/0xdeb1953cba4b24dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b24d5 expref: 18 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787482.265886:0:14454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d060273ce00, rc 0) 00000100:00100000:0.0:1787787482.266014:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073ff7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+18:14458:x1874630694506752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 222us (4418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787482.266032:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787787482.269809:0:14458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0722250780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694506752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787482.269839:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d0701646800/0xdeb1953cba4b24d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b24dc expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787482.269852:0:14458:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d0701646800/0xdeb1953cba4b24d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b24dc expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787482.270853:0:14458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0722250780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694506880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787482.271553:0:14458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787482.271595:0:14458:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0704e2f000 going to sleep for 11 seconds 00000100:00100000:3.0:1787787482.271753:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694506880 00000100:00100000:3.0:1787787482.271763:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694506880 00000100:00100000:3.0:1787787482.271817:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787787482.271826:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073ff7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+18:14458:x1874630694506880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787482.272201:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073ff7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+18:14458:x1874630694506880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 373us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787482.272210:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787787482.273072:0:14458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0722250780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694506880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787482.273116:0:14458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0722250780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694507008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787482.273166:0:14458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787482.273200:0:14458:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0704e2f000 going to sleep for 11 seconds 00000100:00100000:0.0:1787787482.273300:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694507008 00000100:00100000:0.0:1787787482.273306:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694507008 00000100:00100000:0.0:1787787482.273349:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787787482.273357:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073ff7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+18:14458:x1874630694507008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787787482.278223:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073ff7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+18:14458:x1874630694507008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4855us (5046us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787482.278241:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787787482.282373:0:14458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0722250780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694507008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787787482.283539:0:16678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787787482.283751:0:14458:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787787482.283783:0:14458:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787787482.283794:0:14458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0701646800/0xdeb1953cba4b24d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b24dc expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787482.283807:0:14458:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d0701646800/0xdeb1953cba4b24d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b24dc expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787482.283819:0:14458:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787787482.283821:0:14458:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d0706340800 from 10 10000000:01000000:2.0:1787787482.283824:0:14458:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787787482.283854:0:14458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0701646000/0xdeb1953cba4b24e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787482.283875:0:14458:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9d0701646000/0xdeb1953cba4b24e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787482.283886:0:14458:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9d0701646000/0xdeb1953cba4b24e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787482.283908:0:14458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0722250780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694507136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787787482.283968:0:14458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787482.284008:0:14458:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0704e2f000 going to sleep for 11 seconds 00000100:00100000:1.0:1787787482.284203:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694507136 00000100:00100000:1.0:1787787482.284209:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694507136 00000100:00100000:1.0:1787787482.284264:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787787482.284273:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073ff7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+18:14458:x1874630694507136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787482.284293:0:14453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787482.284306:0:14453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d072212ba00/0xdeb1953cba4b24ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdeb1953cba4b24e3 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787482.284328:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d072212ba00/0xdeb1953cba4b24ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdeb1953cba4b24e3 expref: 19 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787482.284338:0:14453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d072212ba00/0xdeb1953cba4b24ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdeb1953cba4b24e3 expref: 19 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787482.284347:0:14453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d072212ba00, rc 0) 00000100:00100000:1.0:1787787482.284400:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073ff7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+19:14458:x1874630694507136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787482.284407:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787787482.284856:0:14458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0722250780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694507136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787482.284888:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9d0701646000/0xdeb1953cba4b24e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b24ea expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787482.284898:0:14458:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9d0701646000/0xdeb1953cba4b24e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdeb1953cba4b24ea expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787482.284961:0:14458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e4b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694507264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787482.284993:0:14458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787482.285027:0:14458:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0702bc7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787787482.285134:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694507264 00000100:00100000:1.0:1787787482.285138:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694507264 00000100:00100000:1.0:1787787482.285172:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787787482.285178:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073ff7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+19:14458:x1874630694507264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787787482.285570:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073ff7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+19:14458:x1874630694507264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 390us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787482.285578:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787787482.289052:0:14458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e4b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694507264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787482.291649:0:14458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07377e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694507392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787787482.291728:0:14458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787482.291768:0:14458:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0703169780 going to sleep for 11 seconds 00000100:00100000:2.0:1787787482.291901:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694507392 00000100:00100000:2.0:1787787482.291917:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694507392 00000100:00100000:2.0:1787787482.291968:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787787482.291978:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073ff7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+19:14458:x1874630694507392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787482.292173:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073ff7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+19:14458:x1874630694507392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 196us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787482.292190:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787787482.292240:0:14458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07377e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:14458:1874630694507392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787787482.293052:0:16680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787787482.293106:0:14458:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787787482.293122:0:14458:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787787482.293132:0:14458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9d0701646000/0xdeb1953cba4b24e3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b24ea expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787482.293143:0:14458:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9d0701646000/0xdeb1953cba4b24e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdeb1953cba4b24ea expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787482.688525:0:16574:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787483.394799:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787483.396076:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678789504 00000100:00100000:2.0:1787787483.396090:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678789504 00000100:00100000:2.0:1787787483.396176:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:2.0:1787787483.396188:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+6:14426:x1874630678789504:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787787483.396209:0:14460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787483.396227:0:14460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701646200/0xdeb1953cba4b24f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35509 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.396290:0:14460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701647800/0xdeb1953cba4b24f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.396304:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701647800/0xdeb1953cba4b24f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.396317:0:14460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701647800/0xdeb1953cba4b24f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.396351:0:14460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701647c00/0xdeb1953cba4b24ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.396359:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701647c00/0xdeb1953cba4b24ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.396366:0:14460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701647c00/0xdeb1953cba4b24ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.396844:0:14460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b2506 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.396868:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b2506 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.396876:0:14460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b2506 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787483.397186:0:14460:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787787483.397191:0:14460:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787787483.397290:0:14460:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b2506 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.397303:0:14460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701647800/0xdeb1953cba4b24f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.397309:0:14460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701647800/0xdeb1953cba4b24f8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.397316:0:14460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701647800/0xdeb1953cba4b24f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.397332:0:14460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0701647800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787483.397336:0:14460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701647800/0xdeb1953cba4b24f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.397344:0:14460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701647800/0xdeb1953cba4b24f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.397356:0:14460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d07114ac000) 00010000:00010000:2.0:1787787483.397358:0:14460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787483.397363:0:14460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701647800/0xdeb1953cba4b24f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.397370:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701647800/0xdeb1953cba4b24f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.397385:0:14460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701647c00/0xdeb1953cba4b24ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.397391:0:14460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701647c00/0xdeb1953cba4b24ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.397396:0:14460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701647c00/0xdeb1953cba4b24ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.397401:0:14460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0701647c00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787483.397403:0:14460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701647c00/0xdeb1953cba4b24ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.397409:0:14460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701647c00/0xdeb1953cba4b24ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.397429:0:14460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9d07078d0100) 00010000:00010000:2.0:1787787483.397431:0:14460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787483.397435:0:14460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701647c00/0xdeb1953cba4b24ff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.397492:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701647c00/0xdeb1953cba4b24ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.397530:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701646200/0xdeb1953cba4b24f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35509 expref: 8 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.398369:0:14460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39800/0xdeb1953cba4b2506 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35509 expref: 7 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.398379:0:14460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d07078d0a00) 00010000:00010000:2.0:1787787483.398381:0:14460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787787483.398384:0:14460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd39800, rc 0) 00000100:00100000:2.0:1787787483.398484:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+7:14426:x1874630678789504:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 2299us (3694us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787483.398494:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00080000:1.0:1787787483.398616:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787483.408877:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787483.408996:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678789760 00000100:00100000:1.0:1787787483.409005:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678789760 00000100:00100000:1.0:1787787483.409059:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:1.0:1787787483.409069:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+7:14426:x1874630678789760:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787787483.409103:0:15164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787483.409124:0:15164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b400/0xdeb1953cba4b250d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35510 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.409197:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212be00/0xdeb1953cba4b2514 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.409211:0:15164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212be00/0xdeb1953cba4b2514 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.409222:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212be00/0xdeb1953cba4b2514 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.409236:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a400/0xdeb1953cba4b251b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.409255:0:15164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a400/0xdeb1953cba4b251b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.409263:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a400/0xdeb1953cba4b251b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.409791:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a800/0xdeb1953cba4b2522 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.409802:0:15164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a800/0xdeb1953cba4b2522 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.409810:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a800/0xdeb1953cba4b2522 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787483.409821:0:15164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787787483.410078:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212be00/0xdeb1953cba4b2514 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.410088:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212be00/0xdeb1953cba4b2514 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.410094:0:15164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212be00/0xdeb1953cba4b2514 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.410100:0:15164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212be00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787483.410104:0:15164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212be00/0xdeb1953cba4b2514 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.410112:0:15164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212be00/0xdeb1953cba4b2514 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.410124:0:15164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d07078d0a00) 00010000:00010000:1.0:1787787483.410127:0:15164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787483.410131:0:15164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212be00/0xdeb1953cba4b2514 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.410139:0:15164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212be00/0xdeb1953cba4b2514 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.410150:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a400/0xdeb1953cba4b251b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.410157:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a400/0xdeb1953cba4b251b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.410162:0:15164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a400/0xdeb1953cba4b251b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.410176:0:15164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212a400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787483.410180:0:15164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a400/0xdeb1953cba4b251b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.410186:0:15164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a400/0xdeb1953cba4b251b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.410194:0:15164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9d07114ac800) 00010000:00010000:1.0:1787787483.410196:0:15164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787483.410199:0:15164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a400/0xdeb1953cba4b251b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.410205:0:15164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a400/0xdeb1953cba4b251b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.410616:0:15164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b400/0xdeb1953cba4b250d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35510 expref: 10 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.410632:0:15164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a800/0xdeb1953cba4b2522 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35510 expref: 9 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.410641:0:15164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d07114ac700) 00010000:00010000:1.0:1787787483.410644:0:15164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787483.410646:0:15164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d072212a800, rc 0) 00000100:00100000:1.0:1787787483.410740:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+9:14426:x1874630678789760:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 1671us (1871us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787787483.410749:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:3.0:1787787483.420327:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787483.420597:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678789888 00000100:00100000:1.0:1787787483.420617:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678789888 00000100:00100000:1.0:1787787483.420682:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 17 00000100:00100000:1.0:1787787483.420693:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0afca4d-e329-45bc-884c-b1ba8eafd358+9:14426:x1874630678789888:12345-192.168.206.10@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787787483.420817:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0afca4d-e329-45bc-884c-b1ba8eafd358+9:14426:x1874630678789888:12345-192.168.206.10@tcp:59:lhsmtool_posix.0 Request processed in 125us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787483.420825:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 17 00000100:00100000:2.0:1787787483.484066:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787483.484272:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678790016 00000100:00100000:1.0:1787787483.484282:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678790016 00000100:00100000:1.0:1787787483.484353:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 18 00000100:00100000:1.0:1787787483.484364:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0722251e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+9:14432:x1874630678790016:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787787483.484383:0:15164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787483.484402:0:15164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b400/0xdeb1953cba4b2530 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35517 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.484523:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a400/0xdeb1953cba4b2537 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.484539:0:15164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a400/0xdeb1953cba4b2537 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.484551:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a400/0xdeb1953cba4b2537 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.484564:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212be00/0xdeb1953cba4b253e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.484571:0:15164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212be00/0xdeb1953cba4b253e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.484577:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212be00/0xdeb1953cba4b253e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.484843:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a400/0xdeb1953cba4b2537 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.484862:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a400/0xdeb1953cba4b2537 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.484869:0:15164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a400/0xdeb1953cba4b2537 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.484875:0:15164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212a400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787483.484879:0:15164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a400/0xdeb1953cba4b2537 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.484887:0:15164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a400/0xdeb1953cba4b2537 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.484899:0:15164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d07114ac000) 00010000:00010000:1.0:1787787483.484902:0:15164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787483.484906:0:15164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a400/0xdeb1953cba4b2537 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.484913:0:15164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a400/0xdeb1953cba4b2537 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.484925:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212be00/0xdeb1953cba4b253e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.484931:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212be00/0xdeb1953cba4b253e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.484936:0:15164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212be00/0xdeb1953cba4b253e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.484946:0:15164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212be00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787483.484949:0:15164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212be00/0xdeb1953cba4b253e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.484955:0:15164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212be00/0xdeb1953cba4b253e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.484962:0:15164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d07114ac800) 00010000:00010000:1.0:1787787483.484964:0:15164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787483.484967:0:15164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212be00/0xdeb1953cba4b253e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.484973:0:15164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212be00/0xdeb1953cba4b253e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.485004:0:15164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b400/0xdeb1953cba4b2530 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35517 expref: 10 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.485014:0:15164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d07114ac000) 00010000:00010000:1.0:1787787483.485016:0:15164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787483.485019:0:15164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b400/0xdeb1953cba4b2530 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35517 expref: 10 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.485028:0:15164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d072212b400, rc 0) 00000100:00100000:1.0:1787787483.485086:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0722251e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+9:14432:x1874630678790016:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 724us (1031us total) trans 0 rc 301/301 00000100:00100000:1.0:1787787483.485094:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 18 00000100:00100000:3.0:1787787483.491645:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787483.491913:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678790144 00000100:00100000:0.0:1787787483.491922:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678790144 00000100:00100000:0.0:1787787483.491973:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:0.0:1787787483.491984:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e0afca4d-e329-45bc-884c-b1ba8eafd358+9:14432:x1874630678790144:12345-192.168.206.10@tcp:700:lfs.0 00000100:00100000:0.0:1787787483.492062:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e0afca4d-e329-45bc-884c-b1ba8eafd358+9:14432:x1874630678790144:12345-192.168.206.10@tcp:700:lfs.0 Request processed in 80us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787483.492070:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:0.0:1787787483.495182:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787483.495318:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678790400 00000100:00100000:3.0:1787787483.495337:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678790400 00000100:00100000:3.0:1787787483.495395:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 19 00000100:00100000:3.0:1787787483.495404:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+9:14432:x1874630678790400:12345-192.168.206.10@tcp:36:lfs.0 00010000:00010000:3.0:1787787483.495494:0:14460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787483.495663:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ae00/0xdeb1953cba4b2473 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35492 expref: 9 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.495686:0:14460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d07114ac000) 00010000:00010000:3.0:1787787483.495691:0:14460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787787483.495974:0:14460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770400/0xdeb1953cba4b2545 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.495989:0:14460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701646e00/0xdeb1953cba4b24ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c354f4 expref: 5 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.495997:0:14460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770400/0xdeb1953cba4b2545 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.496028:0:14460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701646e00/0xdeb1953cba4b24ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c354f4 expref: 5 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.496043:0:14460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701646e00/0xdeb1953cba4b24ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c354f4 expref: 5 pid: 14461 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787483.496058:0:14460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07377e5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14460:1874630694507520:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787787483.497287:0:14460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0703169000 going to sleep for 11 seconds 00000100:00100000:2.0:1787787483.503941:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787483.504145:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678790528 00000100:00100000:0.0:1787787483.504165:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678790528 00010000:00010000:0.0:1787787483.504212:0:14447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701646e00/0xdeb1953cba4b24ab lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c354f4 expref: 6 pid: 14461 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787483.504289:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:0.0:1787787483.504298:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0722252d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03f96fcc-4037-472b-8e81-03f071a5e665+6:2345:x1874630678790528:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787483.504314:0:14447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787483.504321:0:14447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701646e00/0xdeb1953cba4b24ab lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c354f4 expref: 6 pid: 14461 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.504340:0:14447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701646e00/0xdeb1953cba4b24ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c354f4 expref: 6 pid: 14461 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.504364:0:14447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d07114ac000) 00010000:00010000:0.0:1787787483.504369:0:14447:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770400/0xdeb1953cba4b2545 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.504378:0:14447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770400/0xdeb1953cba4b2545 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.504385:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770400/0xdeb1953cba4b2545 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.504403:0:14447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787483.504472:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0722252d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03f96fcc-4037-472b-8e81-03f071a5e665+6:2345:x1874630678790528:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 175us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787483.504480:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 9 00010000:00010000:3.0:1787787483.505243:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0701646e00/0xdeb1953cba4b24ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c354f4 expref: 5 pid: 14461 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787483.505261:0:14460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07377e5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14460:1874630694507520:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787787483.505281:0:14460:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770400/0xdeb1953cba4b2545 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.505290:0:14460:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770400/0xdeb1953cba4b2545 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.505296:0:14460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770400/0xdeb1953cba4b2545 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.505317:0:14460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770a00/0xdeb1953cba4b254c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.505337:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770a00/0xdeb1953cba4b254c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.505346:0:14460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770a00/0xdeb1953cba4b254c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787787483.509292:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1787787483.518410:0:14460:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787787483.518427:0:14460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770400/0xdeb1953cba4b2545 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.519427:0:14460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770400/0xdeb1953cba4b2545 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.519479:0:14460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770400/0xdeb1953cba4b2545 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.519486:0:14460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708770400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787483.519499:0:14460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770400/0xdeb1953cba4b2545 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.519516:0:14460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770400/0xdeb1953cba4b2545 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.519612:0:14460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d07114ac000) 00010000:00010000:2.0:1787787483.519616:0:14460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787483.519622:0:14460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770400/0xdeb1953cba4b2545 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.519629:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770400/0xdeb1953cba4b2545 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787787483.519654:0:14460:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002d4fb25e reply state 00000000f7d96c5a transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770a00/0xdeb1953cba4b254c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787483.519664:0:14460:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787787483.519831:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+10:14432:x1874630678790400:12345-192.168.206.10@tcp:36:lfs.0 Request processed in 24424us (24654us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787787483.519839:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 19 00010000:00010000:3.0:1787787483.529126:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770a00/0xdeb1953cba4b254c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.529142:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770a00/0xdeb1953cba4b254c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.529161:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770a00/0xdeb1953cba4b254c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.529168:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708770a00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787483.529184:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770a00/0xdeb1953cba4b254c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.529192:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770a00/0xdeb1953cba4b254c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.529208:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d071b71d800) 00010000:00010000:3.0:1787787483.529211:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787483.529216:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770a00/0xdeb1953cba4b254c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.529223:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770a00/0xdeb1953cba4b254c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787483.610987:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787483.611181:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678790656 00000100:00100000:1.0:1787787483.611192:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678790656 00000100:00100000:1.0:1787787483.611256:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 20 00000100:00100000:1.0:1787787483.611267:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+9:14440:x1874630678790656:12345-192.168.206.10@tcp:101:lctl.0 00010000:00010000:1.0:1787787483.611291:0:15164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787483.611314:0:15164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b400/0xdeb1953cba4b2553 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3551e expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.611380:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212be00/0xdeb1953cba4b255a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.611393:0:15164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212be00/0xdeb1953cba4b255a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.611405:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212be00/0xdeb1953cba4b255a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787483.612201:0:15164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787787483.612207:0:15164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787787483.612262:0:15164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212be00/0xdeb1953cba4b255a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.612293:0:15164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b400/0xdeb1953cba4b2553 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3551e expref: 11 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.612312:0:15164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212be00/0xdeb1953cba4b255a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3551e expref: 10 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.612321:0:15164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d07114ac800) 00010000:00010000:1.0:1787787483.612324:0:15164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787787483.612341:0:15164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d072212be00, rc 0) 00000100:00100000:1.0:1787787483.612416:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+10:14440:x1874630678790656:12345-192.168.206.10@tcp:101:lctl.0 Request processed in 1151us (1437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787483.612426:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 20 00000100:00100000:2.0:1787787483.646070:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787483.646183:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678790784 00000100:00100000:1.0:1787787483.646192:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678790784 00000100:00100000:1.0:1787787483.646248:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 21 00000100:00100000:1.0:1787787483.646258:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07222512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03f96fcc-4037-472b-8e81-03f071a5e665+5:14441:x1874630678790784:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787787483.646277:0:14462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787483.646296:0:14462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b400/0xdeb1953cba4b2561 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35525 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.646360:0:14462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a400/0xdeb1953cba4b2568 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.646374:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a400/0xdeb1953cba4b2568 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.646385:0:14462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a400/0xdeb1953cba4b2568 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787483.646486:0:14462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787787483.646491:0:14462:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787787483.646520:0:14462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a400/0xdeb1953cba4b2568 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.646557:0:14462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b400/0xdeb1953cba4b2561 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35525 expref: 7 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.646585:0:14462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a400/0xdeb1953cba4b2568 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35525 expref: 6 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.646608:0:14462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d07114ac800) 00010000:00010000:1.0:1787787483.646611:0:14462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787787483.646615:0:14462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d072212a400, rc 0) 00000100:00100000:0.0:1787787483.651790:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07222512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03f96fcc-4037-472b-8e81-03f071a5e665+6:14441:x1874630678790784:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 5521us (5718us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787483.651803:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 21 00000100:00100000:3.0:1787787483.665274:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787483.665988:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678790912 00000100:00100000:2.0:1787787483.666005:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678790912 00000100:00100000:2.0:1787787483.666095:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 22 00000100:00100000:2.0:1787787483.666108:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03f96fcc-4037-472b-8e81-03f071a5e665+6:14441:x1874630678790912:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787787483.666152:0:14461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787483.666177:0:14461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b256f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3552c expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.666270:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b2576 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.666288:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b2576 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.666303:0:14461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b2576 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.666321:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b257d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.666328:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b257d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.666335:0:14461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b257d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.667300:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b2584 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.667325:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b2584 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.667337:0:14461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b2584 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787483.667429:0:14461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787787483.667485:0:14461:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787787483.667515:0:14461:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b2584 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.667529:0:14461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b2576 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.667536:0:14461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b2576 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.667542:0:14461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b2576 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.667549:0:14461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39e00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787483.667553:0:14461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b2576 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.667559:0:14461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b2576 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.667682:0:14461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d07114ac800) 00010000:00010000:2.0:1787787483.667685:0:14461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787483.667690:0:14461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b2576 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.667697:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39e00/0xdeb1953cba4b2576 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.667713:0:14461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b257d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.667719:0:14461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b257d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.667734:0:14461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b257d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.667739:0:14461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787483.667742:0:14461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b257d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.667748:0:14461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b257d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.667755:0:14461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d07078d0100) 00010000:00010000:2.0:1787787483.667757:0:14461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787483.667760:0:14461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b257d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.667766:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39000/0xdeb1953cba4b257d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.667803:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38c00/0xdeb1953cba4b256f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3552c expref: 8 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.667817:0:14461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b2584 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3552c expref: 7 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.667824:0:14461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d07078d0000) 00010000:00010000:2.0:1787787483.667826:0:14461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787787483.667829:0:14461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd38400, rc 0) 00000100:00100000:2.0:1787787483.668079:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03f96fcc-4037-472b-8e81-03f071a5e665+7:14441:x1874630678790912:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 1972us (2816us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787483.669898:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 22 00000100:00100000:2.0:1787787483.691659:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787483.691811:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678791168 00000100:00100000:0.0:1787787483.691821:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678791168 00000100:00100000:0.0:1787787483.691904:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 23 00000100:00100000:0.0:1787787483.691915:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0722250780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03f96fcc-4037-472b-8e81-03f071a5e665+7:14441:x1874630678791168:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787787483.691933:0:14460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787483.691952:0:14460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b258b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35533 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787483.692070:0:14460:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787787483.692196:0:14460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b258b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35533 expref: 9 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.692210:0:14460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d07114ac800) 00010000:00010000:0.0:1787787483.692213:0:14460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787787483.692219:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b258b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35533 expref: 9 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.692231:0:14460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d060273c800, rc 0) 00000100:00100000:0.0:1787787483.692292:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0722250780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03f96fcc-4037-472b-8e81-03f071a5e665+8:14441:x1874630678791168:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 379us (642us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1787787483.692299:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 23 00000100:00100000:1.0:1787787483.705552:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787483.705903:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678791424 00000100:00100000:0.0:1787787483.705915:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678791424 00000100:00100000:0.0:1787787483.705994:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 24 00000100:00100000:0.0:1787787483.706005:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03f96fcc-4037-472b-8e81-03f071a5e665+8:14441:x1874630678791424:12345-192.168.206.10@tcp:36:lfs.0 00010000:00010000:0.0:1787787483.706078:0:15164:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787483.706116:0:15164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b2584 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3552c expref: 8 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.706156:0:15164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d07078d0000) 00010000:00010000:0.0:1787787483.706171:0:15164:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787787483.706206:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2599 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.706221:0:15164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2599 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.706233:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2599 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787787483.706907:0:15164:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b4e8ae7 reply state 000000000cb8bdd4 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2599 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787483.706919:0:15164:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787787483.706936:0:15164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:0.0:1787787483.707057:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03f96fcc-4037-472b-8e81-03f071a5e665+9:14441:x1874630678791424:12345-192.168.206.10@tcp:36:lfs.0 Request processed in 1051us (1517us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1787787483.707067:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 24 00010000:00010000:0.0:1787787483.711969:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2599 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.711991:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2599 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.711999:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2599 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.712006:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d060273c800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787483.712011:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2599 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.712041:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2599 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.712061:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d07050f9700) 00010000:00010000:0.0:1787787483.712065:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1787787483.712071:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2599 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.712078:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2599 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.713746:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787483.716910:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787483.717024:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678791680 00000100:00100000:0.0:1787787483.717038:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678791680 00000100:00100000:0.0:1787787483.717113:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:0.0:1787787483.717126:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07222521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03f96fcc-4037-472b-8e81-03f071a5e665+8:14441:x1874630678791680:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:0.0:1787787483.718250:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07222521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03f96fcc-4037-472b-8e81-03f071a5e665+9:14441:x1874630678791680:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 1106us (1333us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787787483.718266:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:3.0:1787787483.722869:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787483.722989:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678791936 00000100:00100000:0.0:1787787483.723002:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678791936 00000100:00100000:0.0:1787787483.723077:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 25 00000100:00100000:0.0:1787787483.723089:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03f96fcc-4037-472b-8e81-03f071a5e665+9:14441:x1874630678791936:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787787483.723123:0:14460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787483.723150:0:14460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b25a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3553a expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.723264:0:14460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c000/0xdeb1953cba4b25a7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.723302:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c000/0xdeb1953cba4b25a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.723317:0:14460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c000/0xdeb1953cba4b25a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.723334:0:14460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273d000/0xdeb1953cba4b25ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.723342:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273d000/0xdeb1953cba4b25ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.723350:0:14460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273d000/0xdeb1953cba4b25ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787483.723803:0:14460:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787787483.724050:0:14460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c000/0xdeb1953cba4b25a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.724059:0:14460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c000/0xdeb1953cba4b25a7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.724066:0:14460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c000/0xdeb1953cba4b25a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.724074:0:14460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d060273c000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787483.724079:0:14460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c000/0xdeb1953cba4b25a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.724088:0:14460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c000/0xdeb1953cba4b25a7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.724118:0:14460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d07114ac800) 00010000:00010000:0.0:1787787483.724121:0:14460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787483.724127:0:14460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c000/0xdeb1953cba4b25a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.724135:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c000/0xdeb1953cba4b25a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.724151:0:14460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273d000/0xdeb1953cba4b25ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.724158:0:14460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273d000/0xdeb1953cba4b25ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.724165:0:14460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273d000/0xdeb1953cba4b25ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.724171:0:14460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d060273d000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787483.724174:0:14460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273d000/0xdeb1953cba4b25ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.724181:0:14460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273d000/0xdeb1953cba4b25ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.724188:0:14460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d07050f9700) 00010000:00010000:0.0:1787787483.724191:0:14460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787483.724195:0:14460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273d000/0xdeb1953cba4b25ae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.724201:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273d000/0xdeb1953cba4b25ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.724757:0:14460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b25a0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3553a expref: 11 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.724773:0:14460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d07114ac800) 00010000:00010000:0.0:1787787483.724776:0:14460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787787483.724780:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b25a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3553a expref: 11 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.724793:0:14460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d060273c800, rc 0) 00000100:00100000:0.0:1787787483.725150:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03f96fcc-4037-472b-8e81-03f071a5e665+10:14441:x1874630678791936:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 2061us (2303us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1787787483.725162:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 25 00000100:00100000:3.0:1787787483.730006:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787483.730120:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678792064 00000100:00100000:0.0:1787787483.730135:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678792064 00000100:00100000:0.0:1787787483.730255:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 26 00000100:00100000:0.0:1787787483.730267:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03f96fcc-4037-472b-8e81-03f071a5e665+10:14441:x1874630678792064:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787787483.730298:0:15164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787483.730325:0:15164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273da00/0xdeb1953cba4b25bc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35541 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.730471:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273ca00/0xdeb1953cba4b25c3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.730503:0:15164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273ca00/0xdeb1953cba4b25c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.730517:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273ca00/0xdeb1953cba4b25c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787483.730609:0:15164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787787483.730613:0:15164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787787483.730777:0:15164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273ca00/0xdeb1953cba4b25c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.730825:0:15164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273da00/0xdeb1953cba4b25bc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35541 expref: 12 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.730848:0:15164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273ca00/0xdeb1953cba4b25c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35541 expref: 11 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.730868:0:15164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d07050f9200) 00010000:00010000:0.0:1787787483.730871:0:15164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787787483.730875:0:15164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d060273ca00, rc 0) 00000100:00100000:0.0:1787787483.731016:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03f96fcc-4037-472b-8e81-03f071a5e665+11:14441:x1874630678792064:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 750us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787483.731024:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 26 00000100:00100000:2.0:1787787483.737271:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787483.737370:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678792192 00000100:00100000:1.0:1787787483.737383:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678792192 00000100:00100000:1.0:1787787483.737499:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 3 00000100:00100000:1.0:1787787483.737513:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0722252940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03f96fcc-4037-472b-8e81-03f071a5e665+11:14441:x1874630678792192:12345-192.168.206.10@tcp:37:lfs.0 00000100:00100000:1.0:1787787483.751405:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0722252940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03f96fcc-4037-472b-8e81-03f071a5e665+11:14441:x1874630678792192:12345-192.168.206.10@tcp:37:lfs.0 Request processed in 13880us (14134us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787483.751423:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 3 00000100:00100000:2.0:1787787483.756132:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787483.756222:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678792448 00000100:00100000:0.0:1787787483.756233:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678792448 00000100:00100000:0.0:1787787483.756359:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:0.0:1787787483.756369:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073ffdf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03f96fcc-4037-472b-8e81-03f071a5e665+11:14441:x1874630678792448:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:0.0:1787787483.757043:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073ffdf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03f96fcc-4037-472b-8e81-03f071a5e665+12:14441:x1874630678792448:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 671us (918us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1787787483.757053:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:2.0:1787787483.839081:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787483.839366:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678792576 00000100:00100000:1.0:1787787483.839380:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678792576 00000100:00100000:1.0:1787787483.839508:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 27 00000100:00100000:1.0:1787787483.839521:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07222521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0afca4d-e329-45bc-884c-b1ba8eafd358+10:14447:x1874630678792576:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:1.0:1787787483.839549:0:14462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787483.839695:0:14462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212bc00/0xdeb1953cba4b25ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35548 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.839782:0:14462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a000/0xdeb1953cba4b25d1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.839798:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a000/0xdeb1953cba4b25d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.839936:0:14462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a000/0xdeb1953cba4b25d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.839973:0:14462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b400/0xdeb1953cba4b25d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.839980:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b400/0xdeb1953cba4b25d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.839987:0:14462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b400/0xdeb1953cba4b25d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.840131:0:14462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ae00/0xdeb1953cba4b25df lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.840141:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ae00/0xdeb1953cba4b25df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.840149:0:14462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ae00/0xdeb1953cba4b25df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787483.840188:0:14462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787787483.840193:0:14462:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787787483.840472:0:14462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ae00/0xdeb1953cba4b25df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.840724:0:14462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a000/0xdeb1953cba4b25d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.840733:0:14462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a000/0xdeb1953cba4b25d1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.840740:0:14462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a000/0xdeb1953cba4b25d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.840759:0:14462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212a000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787483.840765:0:14462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a000/0xdeb1953cba4b25d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.840774:0:14462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a000/0xdeb1953cba4b25d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.840791:0:14462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d07114ac800) 00010000:00010000:1.0:1787787483.840794:0:14462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787483.840800:0:14462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a000/0xdeb1953cba4b25d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.840980:0:14462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a000/0xdeb1953cba4b25d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.840999:0:14462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b400/0xdeb1953cba4b25d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.841006:0:14462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b400/0xdeb1953cba4b25d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.841012:0:14462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b400/0xdeb1953cba4b25d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.841017:0:14462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212b400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787483.841020:0:14462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b400/0xdeb1953cba4b25d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.841026:0:14462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b400/0xdeb1953cba4b25d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.841045:0:14462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d07114ac200) 00010000:00010000:1.0:1787787483.841048:0:14462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787483.841051:0:14462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b400/0xdeb1953cba4b25d8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.841056:0:14462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b400/0xdeb1953cba4b25d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.841105:0:14462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212bc00/0xdeb1953cba4b25ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35548 expref: 12 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.841121:0:14462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ae00/0xdeb1953cba4b25df lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35548 expref: 11 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.841129:0:14462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d07050f9200) 00010000:00010000:1.0:1787787483.841131:0:14462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787787483.841134:0:14462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d072212ae00, rc 0) 00000100:00100000:1.0:1787787483.841361:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07222521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0afca4d-e329-45bc-884c-b1ba8eafd358+11:14447:x1874630678792576:12345-192.168.206.10@tcp:101:bash.0 Request processed in 1841us (2296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787483.841371:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 27 00000100:00100000:2.0:1787787483.855947:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787483.856347:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678792832 00000100:00100000:3.0:1787787483.856361:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678792832 00000100:00100000:3.0:1787787483.856550:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 28 00000100:00100000:3.0:1787787483.856573:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0722252940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+11:14447:x1874630678792832:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:3.0:1787787483.856603:0:14461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787483.856628:0:14461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770a00/0xdeb1953cba4b25e6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3554f expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.856798:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771600/0xdeb1953cba4b25ed lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.856815:0:14461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273ca00/0xdeb1953cba4b25c3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35541 expref: 11 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.856847:0:14461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771600/0xdeb1953cba4b25ed lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.856900:0:14461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273ca00/0xdeb1953cba4b25c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35541 expref: 11 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.856915:0:14461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273ca00/0xdeb1953cba4b25c3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35541 expref: 11 pid: 15164 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787483.856931:0:14461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07377e4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14461:1874630694507648:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787787483.857062:0:14461:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0703169c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787787483.864887:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787483.865047:0:14461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07377e4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14461:1874630694507648:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787787483.865080:0:14461:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771600/0xdeb1953cba4b25ed lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787483.865161:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678792960 00000100:00100000:1.0:1787787483.865169:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678792960 00010000:00010000:1.0:1787787483.865211:0:14446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273ca00/0xdeb1953cba4b25c3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35541 expref: 12 pid: 15164 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787483.865260:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:1.0:1787787483.865270:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03f96fcc-4037-472b-8e81-03f071a5e665+12:2345:x1874630678792960:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787787483.865308:0:14446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787483.865316:0:14446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273ca00/0xdeb1953cba4b25c3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35541 expref: 12 pid: 15164 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.865329:0:14446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273ca00/0xdeb1953cba4b25c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35541 expref: 12 pid: 15164 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.865354:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273ca00/0xdeb1953cba4b25c3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35541 expref: 12 pid: 15164 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.865372:0:14446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d07050f9200) 00010000:00010000:1.0:1787787483.865377:0:14446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771600/0xdeb1953cba4b25ed lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.865387:0:14446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771600/0xdeb1953cba4b25ed lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.865396:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771600/0xdeb1953cba4b25ed lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.865422:0:14446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787483.865532:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03f96fcc-4037-472b-8e81-03f071a5e665+11:2345:x1874630678792960:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 263us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787483.865540:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 10 00010000:00010000:3.0:1787787483.865817:0:14461:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771600/0xdeb1953cba4b25ed lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.865825:0:14461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771600/0xdeb1953cba4b25ed lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.865861:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770c00/0xdeb1953cba4b25f4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.865872:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770c00/0xdeb1953cba4b25f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.865881:0:14461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770c00/0xdeb1953cba4b25f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.870077:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770e00/0xdeb1953cba4b25fb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.870108:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770e00/0xdeb1953cba4b25fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.870122:0:14461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770e00/0xdeb1953cba4b25fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787483.870142:0:14461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787787483.870200:0:14461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771600/0xdeb1953cba4b25ed lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.870208:0:14461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771600/0xdeb1953cba4b25ed lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.870216:0:14461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771600/0xdeb1953cba4b25ed lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.870223:0:14461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708771600 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787483.870228:0:14461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771600/0xdeb1953cba4b25ed lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.870249:0:14461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771600/0xdeb1953cba4b25ed lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.870265:0:14461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d07050f9200) 00010000:00010000:3.0:1787787483.870268:0:14461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787483.870275:0:14461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771600/0xdeb1953cba4b25ed lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.870304:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708771600/0xdeb1953cba4b25ed lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787787483.870321:0:14461:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000b175822 reply state 0000000047c3cab6 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770c00/0xdeb1953cba4b25f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787483.870331:0:14461:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787787483.870383:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770a00/0xdeb1953cba4b25e6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3554f expref: 14 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.871192:0:14461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770e00/0xdeb1953cba4b25fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3554f expref: 13 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.871209:0:14461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d071b71dc00) 00010000:00010000:3.0:1787787483.871212:0:14461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1787787483.871216:0:14461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0708770e00, rc 0) 00000100:00100000:3.0:1787787483.871488:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0722252940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+14:14447:x1874630678792832:12345-192.168.206.10@tcp:101:bash.0 Request processed in 14917us (15544us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1787787483.871507:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 28 00010000:00010000:3.0:1787787483.888307:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770c00/0xdeb1953cba4b25f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.888330:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770c00/0xdeb1953cba4b25f4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.888338:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770c00/0xdeb1953cba4b25f4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.888345:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708770c00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:3.0:1787787483.888369:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770c00/0xdeb1953cba4b25f4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.888378:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770c00/0xdeb1953cba4b25f4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.889809:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9d071b71d800) 00010000:00010000:3.0:1787787483.889821:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787483.889831:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770c00/0xdeb1953cba4b25f4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.889841:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770c00/0xdeb1953cba4b25f4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787483.908497:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787483.908788:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678793088 00000100:00100000:0.0:1787787483.908811:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678793088 00000100:00100000:0.0:1787787483.908912:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 29 00000100:00100000:0.0:1787787483.908923:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+13:14447:x1874630678793088:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:0.0:1787787483.908954:0:14460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787483.908980:0:14460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273da00/0xdeb1953cba4b2609 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35556 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.909062:0:14460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2610 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.909079:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2610 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.909092:0:14460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2610 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787483.909141:0:14460:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787787483.909145:0:14460:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787787483.909171:0:14460:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2610 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.909183:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2610 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.909209:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273da00/0xdeb1953cba4b2609 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35556 expref: 15 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.909229:0:14460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2610 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35556 expref: 14 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.909251:0:14460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d071b71dc00) 00010000:00010000:0.0:1787787483.909261:0:14460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787787483.909265:0:14460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d060273c800, rc 0) 00000100:00100000:0.0:1787787483.909341:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+14:14447:x1874630678793088:12345-192.168.206.10@tcp:101:bash.0 Request processed in 420us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787483.909349:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 29 00000100:00100000:2.0:1787787483.927609:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787483.927785:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678793344 00000100:00100000:1.0:1787787483.927800:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678793344 00000100:00100000:1.0:1787787483.927957:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:1.0:1787787483.927969:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+14:14447:x1874630678793344:12345-192.168.206.10@tcp:35:bash.0 00000100:00100000:1.0:1787787483.928513:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+15:14447:x1874630678793344:12345-192.168.206.10@tcp:35:bash.0 Request processed in 544us (920us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1787787483.928523:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 5 00000040:00080000:2.0:1787787483.966022:0:14492:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787787484.095598:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787484.096031:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678793600 00000100:00100000:0.0:1787787484.096044:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678793600 00000100:00100000:0.0:1787787484.096128:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 30 00000100:00100000:0.0:1787787484.096140:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+15:14457:x1874630678793600:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787787484.096173:0:15164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787484.096199:0:15164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273da00/0xdeb1953cba4b2617 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3555d expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787484.096358:0:15164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787787484.100170:0:15164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273da00/0xdeb1953cba4b2617 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3555d expref: 17 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.100197:0:15164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d07114ac800) 00010000:00010000:0.0:1787787484.100200:0:15164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787787484.100207:0:15164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273da00/0xdeb1953cba4b2617 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3555d expref: 17 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.100225:0:15164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d060273da00, rc 0) 00000100:00100000:0.0:1787787484.100333:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+16:14457:x1874630678793600:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 4194us (4747us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1787787484.100343:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 30 00000100:00100000:2.0:1787787484.111079:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787484.112980:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678793856 00000100:00100000:1.0:1787787484.113001:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678793856 00000100:00100000:1.0:1787787484.113097:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:1.0:1787787484.113109:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+16:14457:x1874630678793856:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:1.0:1787787484.113499:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+17:14457:x1874630678793856:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 391us (2434us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787787484.113508:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:2.0:1787787484.177000:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787484.177126:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678794112 00000100:00100000:0.0:1787787484.177157:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678794112 00000100:00100000:0.0:1787787484.177237:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 31 00000100:00100000:0.0:1787787484.177247:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+17:14460:x1874630678794112:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787787484.177279:0:14460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787484.177317:0:14460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273da00/0xdeb1953cba4b2625 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35564 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.177513:0:14460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273d000/0xdeb1953cba4b262c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.177530:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273d000/0xdeb1953cba4b262c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.177544:0:14460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273d000/0xdeb1953cba4b262c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787484.177557:0:14460:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787787484.177727:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273da00/0xdeb1953cba4b2625 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35564 expref: 20 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.177748:0:14460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273d000/0xdeb1953cba4b262c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35564 expref: 19 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.177757:0:14460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d071b71dc00) 00010000:00010000:0.0:1787787484.177760:0:14460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787787484.177764:0:14460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d060273d000, rc 0) 00000100:00100000:0.0:1787787484.177863:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+19:14460:x1874630678794112:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 603us (863us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787787484.177872:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 31 00000100:00100000:2.0:1787787484.184301:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787484.184353:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787484.184496:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678794240 00000100:00100000:0.0:1787787484.184513:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678794240 00000100:00100000:0.0:1787787484.184574:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 32 00000100:00100000:0.0:1787787484.184585:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+19:14460:x1874630678794240:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:0.0:1787787484.184670:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273da00/0xdeb1953cba4b263a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.184690:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273da00/0xdeb1953cba4b263a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.184703:0:14461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273da00/0xdeb1953cba4b263a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.184736:0:14461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273da00/0xdeb1953cba4b263a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.184743:0:14461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273da00/0xdeb1953cba4b263a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.184750:0:14461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273da00/0xdeb1953cba4b263a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.184755:0:14461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d060273da00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787484.184760:0:14461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273da00/0xdeb1953cba4b263a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.184769:0:14461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273da00/0xdeb1953cba4b263a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.184782:0:14461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d071b71dc00) 00010000:00010000:0.0:1787787484.184785:0:14461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787787484.184807:0:14461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273da00/0xdeb1953cba4b263a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.184815:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273da00/0xdeb1953cba4b263a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787484.184918:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+19:14460:x1874630678794240:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 333us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787484.184926:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 32 00000100:00100000:3.0:1787787484.185059:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678794368 00000100:00100000:3.0:1787787484.185064:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678794368 00000100:00100000:3.0:1787787484.185119:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:3.0:1787787484.185127:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe83c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0afca4d-e329-45bc-884c-b1ba8eafd358+19:2344:x1874630678794368:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787484.185140:0:14448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787484.185158:0:14448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273d000/0xdeb1953cba4b262c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35564 expref: 19 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787484.185169:0:14448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d071b71dc00) 00010000:00010000:3.0:1787787484.185172:0:14448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787484.185193:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe83c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0afca4d-e329-45bc-884c-b1ba8eafd358+18:2344:x1874630678794368:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 68us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787484.185200:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:2.0:1787787484.191173:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787484.191623:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678794624 00000100:00100000:1.0:1787787484.191636:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678794624 00000100:00100000:1.0:1787787484.191919:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:1.0:1787787484.191933:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+18:14460:x1874630678794624:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:1.0:1787787484.192299:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+19:14460:x1874630678794624:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 368us (1140us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787787484.192309:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:2.0:1787787484.478007:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787484.478112:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678794880 00000100:00100000:0.0:1787787484.478124:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678794880 00000100:00100000:0.0:1787787484.478184:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 33 00000100:00100000:0.0:1787787484.478194:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+19:14491:x1874630678794880:12345-192.168.206.10@tcp:101:cat.0 00010000:00010000:0.0:1787787484.478219:0:14460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787484.478240:0:14460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273da00/0xdeb1953cba4b2641 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3556b expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.478345:0:14460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c000/0xdeb1953cba4b2648 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.478361:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c000/0xdeb1953cba4b2648 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.478373:0:14460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c000/0xdeb1953cba4b2648 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787484.478384:0:14460:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787787484.478986:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273da00/0xdeb1953cba4b2641 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3556b expref: 22 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.479007:0:14460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c000/0xdeb1953cba4b2648 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3556b expref: 21 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.479032:0:14460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d071b71dc00) 00010000:00010000:0.0:1787787484.479034:0:14460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787787484.479037:0:14460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d060273c000, rc 0) 00000100:00100000:0.0:1787787484.479191:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+21:14491:x1874630678794880:12345-192.168.206.10@tcp:101:cat.0 Request processed in 998us (1191us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1787787484.479199:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 33 00000100:00100000:2.0:1787787484.486323:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787484.486366:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787484.486470:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678795264 00000100:00100000:0.0:1787787484.486494:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678795264 00000100:00100000:0.0:1787787484.486557:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00100000:0.0:1787787484.486795:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe82580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+21:2345:x1874630678795264:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787484.486817:0:14447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787484.486855:0:14447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c000/0xdeb1953cba4b2648 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3556b expref: 21 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.486873:0:14447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d071b71dc00) 00010000:00010000:0.0:1787787484.486878:0:14447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787484.486937:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe82580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+20:2345:x1874630678795264:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 371us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787484.486945:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00100000:1.0:1787787484.487064:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678795136 00000100:00100000:1.0:1787787484.487069:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678795136 00000100:00100000:1.0:1787787484.487109:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:1.0:1787787484.487117:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+20:14491:x1874630678795136:12345-192.168.206.10@tcp:35:cat.0 00000100:00100000:1.0:1787787484.487380:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+21:14491:x1874630678795136:12345-192.168.206.10@tcp:35:cat.0 Request processed in 263us (1067us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1787787484.487387:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:2.0:1787787484.533076:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787484.533184:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678795520 00000100:00100000:0.0:1787787484.533194:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678795520 00000100:00100000:0.0:1787787484.533255:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 34 00000100:00100000:0.0:1787787484.533266:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+21:14497:x1874630678795520:12345-192.168.206.10@tcp:101:dd.0 00010000:00010000:0.0:1787787484.533291:0:14461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787484.533310:0:14461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c000/0xdeb1953cba4b2656 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35572 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.533429:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273da00/0xdeb1953cba4b265d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.533479:0:14461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770e00/0xdeb1953cba4b25fb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3554f expref: 22 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.533488:0:14461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2610 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35556 expref: 22 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.533496:0:14461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273da00/0xdeb1953cba4b265d lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.533529:0:14461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2610 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35556 expref: 22 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.533542:0:14461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2610 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35556 expref: 22 pid: 14460 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787484.533555:0:14461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e48000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14461:1874630694507776:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787787484.533647:0:14461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770e00/0xdeb1953cba4b25fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3554f expref: 22 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.533657:0:14461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770e00/0xdeb1953cba4b25fb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3554f expref: 22 pid: 14461 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787484.533667:0:14461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e483c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14461:1874630694507904:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787787484.533700:0:14461:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07054cda80 going to sleep for 11 seconds 00000100:00100000:0.0:1787787484.537114:0:14461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e48000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14461:1874630694507776:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787787484.537135:0:14461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e483c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14461:1874630694507904:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787787484.537169:0:14461:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273da00/0xdeb1953cba4b265d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787484.539868:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787484.539917:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787484.539987:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678795648 00000100:00100000:1.0:1787787484.540017:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678795648 00010000:00010000:1.0:1787787484.540064:0:14446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2610 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35556 expref: 23 pid: 14460 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787484.540111:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678795776 00000100:00100000:1.0:1787787484.540115:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678795776 00010000:00010000:1.0:1787787484.540130:0:14446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770e00/0xdeb1953cba4b25fb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3554f expref: 24 pid: 14461 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787484.540151:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:1.0:1787787484.540163:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+24:2344:x1874630678795648:12345-192.168.206.10@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787787484.540163:0:14447:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787787484.540184:0:14447:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1787787484.540190:0:14446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787484.540199:0:14446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2610 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35556 expref: 24 pid: 14460 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787484.540216:0:14446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2610 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35556 expref: 24 pid: 14460 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787484.540361:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2610 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35556 expref: 24 pid: 14460 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787484.540381:0:14446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d071b71dc00) 00010000:00010000:1.0:1787787484.540387:0:14446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273da00/0xdeb1953cba4b265d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787484.540396:0:14446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273da00/0xdeb1953cba4b265d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787484.540403:0:14446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787484.540534:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+23:2344:x1874630678795648:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 372us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787484.540544:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:1.0:1787787484.540621:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:1.0:1787787484.540629:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe830c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+22:2344:x1874630678795776:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787787484.540640:0:14446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787484.540647:0:14446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770e00/0xdeb1953cba4b25fb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3554f expref: 22 pid: 14461 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787484.540658:0:14446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770e00/0xdeb1953cba4b25fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3554f expref: 22 pid: 14461 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787484.540673:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0708770e00/0xdeb1953cba4b25fb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3554f expref: 22 pid: 14461 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787484.540690:0:14446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d071b71dc00) 00010000:00010000:1.0:1787787484.540694:0:14446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273da00/0xdeb1953cba4b265d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787484.540701:0:14446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273da00/0xdeb1953cba4b265d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787484.540709:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273da00/0xdeb1953cba4b265d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787484.540745:0:14446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787484.540779:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe830c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+21:2344:x1874630678795776:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 150us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787484.540787:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 12 00010000:00010000:1.0:1787787484.540830:0:14461:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273da00/0xdeb1953cba4b265d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787484.540838:0:14461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273da00/0xdeb1953cba4b265d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787484.540866:0:14461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787787484.541049:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c000/0xdeb1953cba4b2656 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35572 expref: 22 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787484.541066:0:14461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273da00/0xdeb1953cba4b265d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35572 expref: 21 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787484.541074:0:14461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d071b71dc00) 00010000:00010000:1.0:1787787484.541076:0:14461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787787484.541079:0:14461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d060273da00, rc 0) 00000100:00100000:1.0:1787787484.542058:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+21:14497:x1874630678795520:12345-192.168.206.10@tcp:101:dd.0 Request processed in 8788us (8988us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1787787484.542069:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 34 00000100:00100000:2.0:1787787484.562028:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787484.562662:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678796032 00000100:00100000:0.0:1787787484.562680:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678796032 00000100:00100000:0.0:1787787484.562840:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 35 00000100:00100000:0.0:1787787484.562864:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+21:14497:x1874630678796032:12345-192.168.206.10@tcp:36:dd.0 00010000:00010000:0.0:1787787484.563170:0:14460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b266b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.563204:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b266b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.563216:0:14460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b266b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787787484.563263:0:14460:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1787787484.563283:0:14460:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000322d55cb reply state 000000002b1a99f5 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b266b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787484.563290:0:14460:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787787484.563397:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+24:14497:x1874630678796032:12345-192.168.206.10@tcp:36:dd.0 Request processed in 538us (1379us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1787787484.563403:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 35 00000020:00080000:0.0:1787787484.563423:0:14460:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787787484.570793:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787484.571112:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678796160 00000100:00100000:1.0:1787787484.571125:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678796160 00000100:00100000:1.0:1787787484.571281:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 36 00000100:00100000:1.0:1787787484.571295:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+24:14497:x1874630678796160:12345-192.168.206.10@tcp:101:dd.0 00010000:00010000:1.0:1787787484.571325:0:15164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787484.571351:0:15164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212bc00/0xdeb1953cba4b2672 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35579 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787484.571432:0:15164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212bc00/0xdeb1953cba4b2672 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35579 expref: 25 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787484.572004:0:15164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212bc00/0xdeb1953cba4b2672 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35579 expref: 25 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.572134:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b266b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.572145:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b266b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.572153:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b266b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.572160:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d060273c400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787484.572165:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b266b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.572174:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b266b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.572299:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d071b71dc00) 00010000:00010000:0.0:1787787484.572303:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787484.572309:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b266b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787484.572316:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b266b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787484.572387:0:15164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d071b71dc00) 00010000:00010000:3.0:1787787484.572391:0:15164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787787484.572402:0:15164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d072212bc00, rc 0) 00000100:00100000:3.0:1787787484.572812:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+24:14497:x1874630678796160:12345-192.168.206.10@tcp:101:dd.0 Request processed in 1517us (2029us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787484.572823:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 36 00000100:00100000:2.0:1787787484.585597:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787484.588395:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678796416 00000100:00100000:1.0:1787787484.588414:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678796416 00000100:00100000:2.0:1787787484.589110:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:2.0:1787787484.589126:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe82d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+24:14497:x1874630678796416:12345-192.168.206.10@tcp:103:dd.0 00010000:00010000:2.0:1787787484.589148:0:14446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787484.589192:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212bc00/0xdeb1953cba4b2672 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35579 expref: 24 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787484.589218:0:14446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d071b71dc00) 00010000:00010000:2.0:1787787484.589225:0:14446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787484.589314:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe82d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+23:14497:x1874630678796416:12345-192.168.206.10@tcp:103:dd.0 Request processed in 192us (3733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787484.589323:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:2.0:1787787484.596598:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787484.596703:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678796544 00000100:00100000:1.0:1787787484.596716:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678796544 00000100:00100000:1.0:1787787484.596782:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 37 00000100:00100000:1.0:1787787484.596793:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0afca4d-e329-45bc-884c-b1ba8eafd358+23:14497:x1874630678796544:12345-192.168.206.10@tcp:58:dd.0 00010000:00010000:1.0:1787787484.596931:0:14462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a000/0xdeb1953cba4b2679 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787484.596953:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a000/0xdeb1953cba4b2679 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787484.596968:0:14462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a000/0xdeb1953cba4b2679 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787787484.598838:0:14462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787787484.605994:0:14462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1787787484.606409:0:14462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1787787484.607101:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0afca4d-e329-45bc-884c-b1ba8eafd358+23:14497:x1874630678796544:12345-192.168.206.10@tcp:58:dd.0 Request processed in 10301us (10508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787484.607118:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 37 00000100:00100000:1.0:1787787484.622332:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787484.622481:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678796672 00000100:00100000:2.0:1787787484.622548:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678796672 00000100:00100000:2.0:1787787484.622706:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 38 00000100:00100000:2.0:1787787484.622717:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+23:14497:x1874630678796672:12345-192.168.206.10@tcp:101:dd.0 00010000:00010000:2.0:1787787484.622742:0:14461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787484.622766:0:14461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39a00/0xdeb1953cba4b2680 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35580 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787484.622841:0:14461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a000/0xdeb1953cba4b2679 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787484.622862:0:14461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39a00/0xdeb1953cba4b2680 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35580 expref: 24 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787484.622884:0:14461:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a000/0xdeb1953cba4b2679 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787484.622914:0:14461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39a00/0xdeb1953cba4b2680 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35580 expref: 24 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787484.622927:0:14461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d071b71dc00) 00010000:00010000:2.0:1787787484.622929:0:14461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787787484.622933:0:14461:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39a00/0xdeb1953cba4b2680 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35580 expref: 24 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787484.622939:0:14461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd39a00, rc 0) 00000100:00100000:2.0:1787787484.623016:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+24:14497:x1874630678796672:12345-192.168.206.10@tcp:101:dd.0 Request processed in 301us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787484.623024:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 38 00000100:00100000:2.0:1787787484.648770:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787484.648894:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787484.648973:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787484.649021:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787484.649041:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787484.649068:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787484.649099:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678796928 00000100:00100000:2.0:1787787484.649110:0:15144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678796928 00000100:00100000:2.0:1787787484.649171:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678797440 00000100:00100000:2.0:1787787484.649174:0:15144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678797440 00000100:00100000:2.0:1787787484.649186:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678797056 00000100:00100000:2.0:1787787484.649188:0:15144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678797056 00000100:00100000:2.0:1787787484.649201:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678797312 00000100:00100000:2.0:1787787484.649203:0:15144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678797312 00000100:00100000:2.0:1787787484.649222:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:3.0:1787787484.649632:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:3.0:1787787484.649649:0:15143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03f96fcc-4037-472b-8e81-03f071a5e665+5:2345:x1874630678797440:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787484.649764:0:15143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03f96fcc-4037-472b-8e81-03f071a5e665+5:2345:x1874630678797440:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 120us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787484.649772:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:3.0:1787787484.649797:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:3.0:1787787484.649804:0:15143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+5:2345:x1874630678797056:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787484.649964:0:15143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+5:2345:x1874630678797056:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 160us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787484.649971:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:3.0:1787787484.649986:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:3.0:1787787484.649993:0:15143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03f96fcc-4037-472b-8e81-03f071a5e665+5:2345:x1874630678797312:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787484.650017:0:15143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03f96fcc-4037-472b-8e81-03f071a5e665+5:2345:x1874630678797312:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 25us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787484.650024:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00080000:3.0:1787787484.650732:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787787484.650739:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787787484.651304:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678797184 00000100:00100000:0.0:1787787484.651319:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678797184 00000100:00100000:0.0:1787787484.651537:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 22 00000100:00100000:0.0:1787787484.651549:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03f96fcc-4037-472b-8e81-03f071a5e665+11:2345:x1874630678797184:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787787484.651890:0:15144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe83c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0afca4d-e329-45bc-884c-b1ba8eafd358+5:2345:x1874630678796928:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787787484.651890:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03f96fcc-4037-472b-8e81-03f071a5e665+11:2345:x1874630678797184:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 340us (2991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787484.651925:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 22 00000100:00100000:2.0:1787787484.651955:0:15144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe83c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0afca4d-e329-45bc-884c-b1ba8eafd358+5:2345:x1874630678796928:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 2722us (3198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787484.651965:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:1.0:1787787484.652100:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678796800 00000100:00100000:1.0:1787787484.652107:0:14454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678796800 00000100:00100000:1.0:1787787484.652152:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 119 00000100:00100000:1.0:1787787484.652171:0:14454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073ff7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c13b403-cfe9-4f44-8f22-4e16a974f4be+13:2345:x1874630678796800:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787787484.652217:0:14454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073ff7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c13b403-cfe9-4f44-8f22-4e16a974f4be+13:2345:x1874630678796800:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 49us (3196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787484.652224:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 119 00010000:00010000:3.0:1787787484.733861:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787787484.988810:0:14492:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787787484.988824:0:14492:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787787484.988911:0:14492:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787787484.988919:0:14492:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787787484.989116:0:14492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06010b52c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14492:1874630694508032:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787787484.989257:0:14492:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d072b1b6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787787484.997667:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787484.997797:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678797568 00000100:00100000:3.0:1787787484.997809:0:14471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678797568 00000100:00100000:3.0:1787787484.997902:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:3.0:1787787484.997924:0:14471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e0afca4d-e329-45bc-884c-b1ba8eafd358+25:14498:x1874630678797568:12345-192.168.206.10@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787787484.998042:0:14471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e0afca4d-e329-45bc-884c-b1ba8eafd358+25:14498:x1874630678797568:12345-192.168.206.10@tcp:900:lhsmtool_posix.0 Request processed in 120us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787484.998052:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:1.0:1787787484.999983:0:14492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06010b52c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14492:1874630694508032:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787787485.004574:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787485.004782:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678797696 00000100:00100000:0.0:1787787485.004794:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678797696 00000100:00100000:0.0:1787787485.004894:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 39 00000100:00100000:0.0:1787787485.004914:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+24:14498:x1874630678797696:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787787485.004957:0:15164:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787787485.005120:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+24:14498:x1874630678797696:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 216us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787485.005129:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 39 00000100:00080000:3.0:1787787485.005694:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787485.022006:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787485.025590:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678797824 00000100:00100000:1.0:1787787485.025613:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678797824 00000100:00100000:1.0:1787787485.025704:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 40 00000100:00100000:1.0:1787787485.025715:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0afca4d-e329-45bc-884c-b1ba8eafd358+24:14498:x1874630678797824:12345-192.168.206.10@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787787485.026078:0:14462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b200/0xdeb1953cba4b2687 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.026099:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b200/0xdeb1953cba4b2687 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.026116:0:14462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b200/0xdeb1953cba4b2687 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.032966:0:14462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b268e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.032990:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b268e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.033004:0:14462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b268e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.033035:0:14462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ac00/0xdeb1953cba4b2695 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.033061:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ac00/0xdeb1953cba4b2695 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.033078:0:14462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ac00/0xdeb1953cba4b2695 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787485.033120:0:14462:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787787485.033125:0:14462:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787787485.033139:0:14462:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ac00/0xdeb1953cba4b2695 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.033150:0:14462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b200/0xdeb1953cba4b2687 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.033156:0:14462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b200/0xdeb1953cba4b2687 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.033162:0:14462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b200/0xdeb1953cba4b2687 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.033168:0:14462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212b200 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787485.033173:0:14462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b200/0xdeb1953cba4b2687 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.033180:0:14462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b200/0xdeb1953cba4b2687 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.033192:0:14462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d07114ac700) 00010000:00010000:1.0:1787787485.033195:0:14462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787485.033199:0:14462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b200/0xdeb1953cba4b2687 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.033214:0:14462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212b200/0xdeb1953cba4b2687 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.033229:0:14462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b268e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.033235:0:14462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b268e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.033241:0:14462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b268e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.033246:0:14462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212aa00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787485.033249:0:14462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b268e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.033255:0:14462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b268e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.033262:0:14462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9d07114ac200) 00010000:00010000:1.0:1787787485.033264:0:14462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787485.033267:0:14462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b268e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.033271:0:14462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b268e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.033285:0:14462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ac00/0xdeb1953cba4b2695 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.033291:0:14462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ac00/0xdeb1953cba4b2695 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.033302:0:14462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ac00/0xdeb1953cba4b2695 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.033307:0:14462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212ac00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:1.0:1787787485.033310:0:14462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ac00/0xdeb1953cba4b2695 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.033316:0:14462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ac00/0xdeb1953cba4b2695 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.033323:0:14462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d071b71dc00) 00010000:00010000:1.0:1787787485.033326:0:14462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787485.033329:0:14462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ac00/0xdeb1953cba4b2695 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.033335:0:14462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212ac00/0xdeb1953cba4b2695 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787485.033425:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0afca4d-e329-45bc-884c-b1ba8eafd358+24:14498:x1874630678797824:12345-192.168.206.10@tcp:34:lhsmtool_posix.0 Request processed in 7708us (11429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787485.033435:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 40 00000100:00100000:1.0:1787787485.037312:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787485.037493:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678798080 00000100:00100000:0.0:1787787485.037511:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678798080 00000100:00100000:0.0:1787787485.037600:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 41 00000100:00100000:0.0:1787787485.037611:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+24:14498:x1874630678798080:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787787485.037638:0:15164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787485.037666:0:15164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c600/0xdeb1953cba4b269c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35587 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.037804:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b26a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.037823:0:15164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b26a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.037837:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b26a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787485.037885:0:15164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787787485.038022:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b26a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.038031:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b26a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.038038:0:15164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b26a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.038045:0:15164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d060273c400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787485.038049:0:15164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b26a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.038058:0:15164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b26a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.038072:0:15164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d071b71dc00) 00010000:00010000:0.0:1787787485.038076:0:15164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787787485.038081:0:15164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b26a3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.038088:0:15164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b26a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.038143:0:15164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c600/0xdeb1953cba4b269c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35587 expref: 26 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.038155:0:15164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d07114ac700) 00010000:00010000:0.0:1787787485.038157:0:15164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787787485.038168:0:15164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c600/0xdeb1953cba4b269c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35587 expref: 26 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.038179:0:15164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d060273c600, rc 0) 00000100:00100000:0.0:1787787485.038264:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+25:14498:x1874630678798080:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 654us (960us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1787787485.038273:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 41 00000100:00100000:3.0:1787787485.041420:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787485.044752:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678798208 00000100:00100000:0.0:1787787485.044772:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678798208 00000100:00100000:0.0:1787787485.044867:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 42 00000100:00100000:0.0:1787787485.044880:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+25:14498:x1874630678798208:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787787485.044936:0:14460:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787787485.045073:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+25:14498:x1874630678798208:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 196us (3667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787485.045081:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 42 00000100:00100000:3.0:1787787485.048185:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787485.048279:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678798464 00000100:00100000:0.0:1787787485.048290:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678798464 00000100:00100000:0.0:1787787485.048360:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 43 00000100:00100000:0.0:1787787485.048371:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+25:14498:x1874630678798464:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787787485.048395:0:15164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787485.048420:0:15164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c000/0xdeb1953cba4b26b1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3558e expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787787485.049268:0:15164:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:0.0:1787787485.049277:0:15164:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1787787485.049336:0:15164:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1787787485.050791:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c600/0xdeb1953cba4b26b8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.051156:0:15164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c600/0xdeb1953cba4b26b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.051170:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c600/0xdeb1953cba4b26b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.051312:0:15164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c000/0xdeb1953cba4b26b1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3558e expref: 28 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.051332:0:15164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c600/0xdeb1953cba4b26b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3558e expref: 27 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.051348:0:15164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d07050f9700) 00010000:00010000:0.0:1787787485.051350:0:15164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787787485.052106:0:15164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d060273c600, rc 0) 00000100:00100000:0.0:1787787485.052290:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+27:14498:x1874630678798464:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 3918us (4126us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1787787485.052307:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 43 00000100:00100000:2.0:1787787485.065358:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787485.065491:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678798720 00000100:00100000:0.0:1787787485.065505:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678798720 00000100:00100000:0.0:1787787485.065938:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 44 00000100:00100000:0.0:1787787485.065951:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+27:14498:x1874630678798720:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787787485.066031:0:14460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787485.066065:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c600/0xdeb1953cba4b26b8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3558e expref: 27 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.066089:0:14460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d07050f9700) 00010000:00010000:0.0:1787787485.066121:0:14460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787787485.066151:0:14460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c000/0xdeb1953cba4b26c6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.066167:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c000/0xdeb1953cba4b26c6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.066180:0:14460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c000/0xdeb1953cba4b26c6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.066324:0:14460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b26cd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe6da14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.066346:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b26cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe6da14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.066369:0:14460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b26cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe6da14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.066521:0:14460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c000/0xdeb1953cba4b26c6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.066528:0:14460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c000/0xdeb1953cba4b26c6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.066535:0:14460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c000/0xdeb1953cba4b26c6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.066541:0:14460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d060273c000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787485.066545:0:14460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c000/0xdeb1953cba4b26c6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.066552:0:14460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c000/0xdeb1953cba4b26c6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.066753:0:14460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d07050f9200) 00010000:00010000:0.0:1787787485.066756:0:14460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787485.066761:0:14460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c000/0xdeb1953cba4b26c6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.066768:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c000/0xdeb1953cba4b26c6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.066782:0:14460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b26cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe6da14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.066788:0:14460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b26cd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe6da14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.066793:0:14460:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b26cd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe6da14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.066797:0:14460:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d060273c400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787485.066800:0:14460:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b26cd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe6da14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.066805:0:14460:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b26cd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe6da14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.066812:0:14460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xe6da14 (ffff9d07050f9300) 00010000:00010000:0.0:1787787485.066814:0:14460:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787485.066816:0:14460:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b26cd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe6da14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.066821:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b26cd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe6da14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787485.067389:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+26:14498:x1874630678798720:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 1433us (2039us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787787485.067399:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 44 00000100:00100000:3.0:1787787485.070822:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787485.074176:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678798848 00000100:00100000:2.0:1787787485.074197:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678798848 00000100:00100000:2.0:1787787485.074482:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 45 00000100:00100000:2.0:1787787485.074495:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07377e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+26:14498:x1874630678798848:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787787485.074522:0:14461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787485.074555:0:14461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b26d4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c35595 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.074616:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39600/0xdeb1953cba4b26db lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.074647:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39600/0xdeb1953cba4b26db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.074662:0:14461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39600/0xdeb1953cba4b26db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.077063:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b26d4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35595 expref: 28 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.077122:0:14461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39600/0xdeb1953cba4b26db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35595 expref: 27 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.077132:0:14461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d07078d0100) 00010000:00010000:2.0:1787787485.077135:0:14461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787787485.077139:0:14461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd39600, rc 0) 00000100:00100000:2.0:1787787485.077248:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07377e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+27:14498:x1874630678798848:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 2755us (6438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787485.078478:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 45 00000100:00100000:3.0:1787787485.079980:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787485.081136:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678799104 00000100:00100000:1.0:1787787485.081153:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678799104 00000100:00100000:1.0:1787787485.081225:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 46 00000100:00100000:1.0:1787787485.081241:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705974f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0afca4d-e329-45bc-884c-b1ba8eafd358+27:14498:x1874630678799104:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787787485.081343:0:14462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b26e2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.081368:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b26e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.081379:0:14462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b26e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787787485.082828:0:14462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1787787485.082855:0:14462:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 397309415587ns, next at 398309401582ns, rc = 0 00000004:00010000:1.0:1787787485.082980:0:14462:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003ca2f727 reply state 000000009c3d2526 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b26e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787485.082991:0:14462:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787787485.083095:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705974f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e0afca4d-e329-45bc-884c-b1ba8eafd358+29:14498:x1874630678799104:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 1859us (3124us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1787787485.083104:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 46 00000100:00100000:1.0:1787787485.086641:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00010000:00010000:2.0:1787787485.087125:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b26e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.087142:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b26e2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.087150:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b26e2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.087157:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212aa00 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787485.087162:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b26e2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.087170:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b26e2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.087190:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d07078d0100) 00010000:00010000:2.0:1787787485.087194:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787787485.087200:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b26e2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.087226:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212aa00/0xdeb1953cba4b26e2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787485.087356:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678799232 00000100:00100000:0.0:1787787485.087372:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678799232 00000100:00100000:0.0:1787787485.087489:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 47 00000100:00100000:0.0:1787787485.087501:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0702fd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+28:14498:x1874630678799232:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787787485.087528:0:15164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787485.087547:0:15164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c600/0xdeb1953cba4b26e9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c3559c expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.087619:0:15164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c600/0xdeb1953cba4b26e9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3559c expref: 29 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.087632:0:15164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c600/0xdeb1953cba4b26e9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3559c expref: 29 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.087651:0:15164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d07078d0100) 00010000:00010000:0.0:1787787485.087655:0:15164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787787485.087658:0:15164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d060273c600, rc 0) 00000100:00100000:0.0:1787787485.087907:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0702fd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+29:14498:x1874630678799232:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 406us (1279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787485.087915:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 47 00000100:00100000:3.0:1787787485.100869:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787485.101724:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678799360 00000100:00100000:2.0:1787787485.101736:0:15143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678799360 00000100:00100000:2.0:1787787485.101817:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:2.0:1787787485.101828:0:15143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0705977840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+5:2344:x1874630678799360:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787787485.102203:0:15143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0705977840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+6:2344:x1874630678799360:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 Request processed in 375us (1340us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787787485.102211:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:3.0:1787787485.107622:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787485.107734:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678799616 00000100:00100000:1.0:1787787485.107749:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678799616 00000100:00100000:1.0:1787787485.107826:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:1.0:1787787485.107838:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707092940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+29:14498:x1874630678799616:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787787485.108267:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707092940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+30:14498:x1874630678799616:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 430us (657us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1787787485.108277:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:1.0:1787787485.122296:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787485.122399:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678799872 00000100:00100000:0.0:1787787485.122417:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678799872 00000100:00100000:0.0:1787787485.122548:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 48 00000100:00100000:0.0:1787787485.122580:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0722251680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+30:14498:x1874630678799872:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787787485.122781:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0722251680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+30:14498:x1874630678799872:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 203us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787485.122790:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 48 00000100:00100000:3.0:1787787485.137563:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787485.138258:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678800000 00000100:00100000:2.0:1787787485.138271:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678800000 00000100:00100000:2.0:1787787485.138339:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 49 00000100:00100000:2.0:1787787485.138349:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07070912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+30:14498:x1874630678800000:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787787485.138373:0:14461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787485.138397:0:14461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b26f0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c355a3 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.138505:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38e00/0xdeb1953cba4b26f7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.138523:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38e00/0xdeb1953cba4b26f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.138535:0:14461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38e00/0xdeb1953cba4b26f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787485.138578:0:14461:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787787485.138613:0:14461:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38e00/0xdeb1953cba4b26f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.138641:0:14461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39400/0xdeb1953cba4b26f0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c355a3 expref: 32 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.138659:0:14461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38e00/0xdeb1953cba4b26f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c355a3 expref: 31 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.138669:0:14461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d07078d0100) 00010000:00010000:2.0:1787787485.138672:0:14461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787787485.138773:0:14461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd38e00, rc 0) 00000100:00100000:2.0:1787787485.138891:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07070912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+31:14498:x1874630678800000:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 542us (1346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787485.138899:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 49 00000100:00100000:3.0:1787787485.159685:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787485.163918:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678800128 00000100:00100000:2.0:1787787485.164324:0:15144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678800128 00000100:00100000:2.0:1787787485.164429:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:2.0:1787787485.164467:0:15144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707090000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0afca4d-e329-45bc-884c-b1ba8eafd358+6:2343:x1874630678800128:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787787485.164492:0:15144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787485.164523:0:15144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000009518/0xdeb1953cba4b26fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c355aa expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787787485.164562:0:15144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f78dc, blocks: 0x1 00010000:00010000:2.0:1787787485.164604:0:15144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=397s v=(0 0) 00010000:00010000:2.0:1787787485.164610:0:15144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787485.164623:0:15144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000009518/0xdeb1953cba4b26fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c355aa expref: 7 pid: 15144 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.164678:0:15144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000000009518/0xdeb1953cba4b26fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c355aa expref: 7 pid: 15144 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.164695:0:15144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d073fd39400, rc 0) 00000100:00100000:2.0:1787787485.164794:0:15144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707090000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0afca4d-e329-45bc-884c-b1ba8eafd358+7:2343:x1874630678800128:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 354us (5124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787485.164803:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:2.0:1787787485.179157:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787485.180018:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678800384 00000100:00100000:0.0:1787787485.180032:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678800384 00000100:00100000:0.0:1787787485.180109:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 50 00000100:00100000:0.0:1787787485.180120:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+31:14498:x1874630678800384:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787787485.180272:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+31:14498:x1874630678800384:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 152us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787485.180281:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 50 00000100:00100000:3.0:1787787485.182910:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787485.183041:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678800512 00000100:00100000:2.0:1787787485.183054:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678800512 00000100:00100000:2.0:1787787485.183180:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 51 00000100:00100000:2.0:1787787485.183191:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707090f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+31:14498:x1874630678800512:12345-192.168.206.10@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787787485.255256:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:0.0:1787787485.255289:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:0.0:1787787485.255304:0:5842:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1787787485.255314:0:5842:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1787787485.255654:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787787485.256817:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707090f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+14:14498:x1874630678800512:12345-192.168.206.10@tcp:44:lhsmtool_posix.0 Request processed in 72732us (73023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787485.256840:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 51 00000100:00100000:1.0:1787787485.257367:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0722250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694508160:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787787485.257572:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787485.257788:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694508160 00000100:00100000:2.0:1787787485.257799:0:15143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694508160 00000100:00100000:2.0:1787787485.258072:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787787485.258085:0:15143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0722252d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694508160:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787787485.258327:0:15143:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787787485.258331:0:15143:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1787787485.258335:0:15143:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787787485.258337:0:15143:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787787484 -> 1787787484 00002000:00010000:2.0:1787787485.258340:0:15143:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787787485.258407:0:15143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0722252d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3291:x1874630694508160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 326us (836us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1787787485.258416:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:1.0:1787787485.258517:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d0722250000/2, rc 0, transno 8589934595 00000100:00100000:1.0:1787787485.258525:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0722250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694508160:0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1787787485.258712:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787787485.259192:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787485.259237:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678800640 00000100:00100000:2.0:1787787485.259243:0:15144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678800640 00000100:00100000:2.0:1787787485.259376:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:2.0:1787787485.259385:0:15144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707093c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0afca4d-e329-45bc-884c-b1ba8eafd358+7:2345:x1874630678800640:12345-192.168.206.10@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787787485.259494:0:15144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707093c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e0afca4d-e329-45bc-884c-b1ba8eafd358+7:2345:x1874630678800640:12345-192.168.206.10@tcp:16:lhsmtool_posix.0 Request processed in 109us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787485.259502:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:3.0:1787787485.267048:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787485.267143:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678800896 00000100:00100000:0.0:1787787485.267157:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678800896 00000100:00100000:0.0:1787787485.267238:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 52 00000100:00100000:0.0:1787787485.267250:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707093840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+14:14498:x1874630678800896:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787787485.267323:0:14460:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787485.267358:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38e00/0xdeb1953cba4b26f7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c355a3 expref: 14 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.267382:0:14460:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d07078d0100) 00010000:00010000:0.0:1787787485.267389:0:14460:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787787485.267508:0:14460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b2705 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.267526:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b2705 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.267536:0:14460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b2705 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787787485.267797:0:14460:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c3cdc576 reply state 000000002c46f9c6 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b2705 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787485.267808:0:14460:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787787485.267966:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707093840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+15:14498:x1874630678800896:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 717us (931us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1787787485.267975:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 52 00010000:00010000:0.0:1787787485.271255:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b2705 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.271280:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b2705 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.271289:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b2705 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.271296:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d060273c400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:0.0:1787787485.271301:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b2705 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.271310:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b2705 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.271331:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d07078d0100) 00010000:00010000:0.0:1787787485.271354:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787485.271361:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b2705 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.271368:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b2705 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14460 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787485.272177:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787485.272892:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678801024 00000100:00100000:0.0:1787787485.272905:0:15141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678801024 00000100:00100000:0.0:1787787485.272980:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:0.0:1787787485.272991:0:15141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707090780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+7:14498:x1874630678801024:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787787485.273013:0:15141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787485.273038:0:15141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000790288a0/0xdeb1953cba4b270c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51f4fe6243c355b1 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.273075:0:15141:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000000009518/0xdeb1953cba4b26fe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c355aa expref: 8 pid: 15144 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.273086:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787485.273090:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787485.273097:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000790288a0/0xdeb1953cba4b270c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c355b1 expref: 8 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.273139:0:15141:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000000009518/0xdeb1953cba4b26fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c355aa expref: 8 pid: 15144 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.273155:0:15141:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000000009518/0xdeb1953cba4b26fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c355aa expref: 8 pid: 15144 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787485.273195:0:15141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e48000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15141:1874630694508288:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787787485.273303:0:15141:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07054cd480 going to sleep for 11 seconds 00000100:00100000:3.0:1787787485.278203:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787485.278311:0:16687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678801152 00000100:00100000:2.0:1787787485.278323:0:16687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678801152 00010000:00010000:2.0:1787787485.278371:0:16687:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000000009518/0xdeb1953cba4b26fe lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c355aa expref: 9 pid: 15144 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787485.278420:0:16687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:2.0:1787787485.278430:0:16687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707090b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+9:2345:x1874630678801152:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787485.278490:0:16687:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787485.278519:0:16687:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000000009518/0xdeb1953cba4b26fe lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c355aa expref: 9 pid: 15144 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.278535:0:16687:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000000009518/0xdeb1953cba4b26fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c355aa expref: 9 pid: 15144 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.278564:0:16687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787485.278570:0:16687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787485.278588:0:16687:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000790288a0/0xdeb1953cba4b270c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c355b1 expref: 9 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.278599:0:16687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000790288a0/0xdeb1953cba4b270c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c355b1 expref: 9 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.278641:0:16687:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000790288a0/0xdeb1953cba4b270c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c355b1 expref: 9 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787485.278657:0:16687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06010b6580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:16687:1874630694508416:192.168.206.10@tcp:105: 00000100:00100000:2.0:1787787485.278759:0:16687:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0706aaad80 going to sleep for 11 seconds 00010000:00010000:0.0:1787787485.279599:0:15141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000009518/0xdeb1953cba4b26fe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c355aa expref: 9 pid: 15144 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787485.279622:0:15141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e48000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15141:1874630694508288:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787787485.279654:0:15141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000790288a0/0xdeb1953cba4b270c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c355b1 expref: 8 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.279667:0:15141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d060273c000, rc 0) 00000100:00100000:0.0:1787787485.279736:0:15141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707090780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+8:14498:x1874630678801024:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 6746us (7566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787485.279745:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:2.0:1787787485.286275:0:16687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06010b6580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:16687:1874630694508416:192.168.206.10@tcp:105: 00010000:00010000:2.0:1787787485.286309:0:16687:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787485.286385:0:16687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707090b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+7:2345:x1874630678801152:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 7955us (8193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787485.286399:0:16687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:1.0:1787787485.299888:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787485.299977:0:15989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678801280 00000100:00100000:3.0:1787787485.299991:0:15989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678801280 00000100:00100000:3.0:1787787485.300069:0:15989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:3.0:1787787485.300081:0:15989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+7:2345:x1874630678801280:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787787485.301470:0:15989:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787787485.301477:0:15989:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787787484 00002000:00010000:2.0:1787787485.301481:0:15989:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787787483 00002000:00010000:2.0:1787787485.301483:0:15989:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787787484 -> 1787787484 00002000:00010000:2.0:1787787485.301496:0:15989:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787787485.301603:0:15989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+8:2345:x1874630678801280:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 Request processed in 1520us (1725us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787787485.301614:0:15989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:1.0:1787787485.307875:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787485.308351:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678801408 00000100:00100000:2.0:1787787485.308370:0:15143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678801408 00000100:00100000:2.0:1787787485.308514:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:2.0:1787787485.308527:0:15143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+8:2342:x1874630678801408:12345-192.168.206.10@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787787485.308598:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001f513ebe/0xdeb1953cba4b2713 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.308626:0:15143:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000790288a0/0xdeb1953cba4b270c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c355b1 expref: 8 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.308644:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787485.308652:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787787485.308658:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f513ebe/0xdeb1953cba4b2713 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.308709:0:15143:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000790288a0/0xdeb1953cba4b270c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c355b1 expref: 8 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.308729:0:15143:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000790288a0/0xdeb1953cba4b270c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c355b1 expref: 8 pid: 15141 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787485.308745:0:15143:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06010b6580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15143:1874630694508544:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787787485.308980:0:15143:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0706aaad80 going to sleep for 11 seconds 00000100:00100000:2.0:1787787485.317994:0:15143:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06010b6580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15143:1874630694508544:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787787485.318033:0:15143:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001f513ebe/0xdeb1953cba4b2713 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787485.321144:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787485.321278:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678801536 00000100:00100000:2.0:1787787485.321290:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678801536 00010000:00010000:2.0:1787787485.321340:0:14446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000790288a0/0xdeb1953cba4b270c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c355b1 expref: 9 pid: 15141 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787485.321392:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:2.0:1787787485.321403:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1df840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+9:2342:x1874630678801536:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787485.321423:0:14446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787485.321490:0:14446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000790288a0/0xdeb1953cba4b270c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c355b1 expref: 9 pid: 15141 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.321507:0:14446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000790288a0/0xdeb1953cba4b270c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c355b1 expref: 9 pid: 15141 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.321537:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000790288a0/0xdeb1953cba4b270c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c355b1 expref: 9 pid: 15141 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.321559:0:14446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787787485.321564:0:14446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787787485.321570:0:14446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001f513ebe/0xdeb1953cba4b2713 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.321582:0:14446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f513ebe/0xdeb1953cba4b2713 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.321645:0:14446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787787485.321891:0:15143:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001f513ebe/0xdeb1953cba4b2713 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787485.321913:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f513ebe/0xdeb1953cba4b2713 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787485.321941:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001f513ebe/0xdeb1953cba4b2713 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787485.321950:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f513ebe/0xdeb1953cba4b2713 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787485.321958:0:15143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f513ebe/0xdeb1953cba4b2713 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787485.321965:0:15143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd38c00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787485.321975:0:15143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f513ebe/0xdeb1953cba4b2713 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787485.321985:0:15143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f513ebe/0xdeb1953cba4b2713 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787485.321999:0:15143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f513ebe/0xdeb1953cba4b2713 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787485.322006:0:15143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f513ebe/0xdeb1953cba4b2713 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787485.322525:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1df840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+8:2342:x1874630678801536:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 1120us (1392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787485.322536:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:3.0:1787787485.322614:0:15143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+7:2342:x1874630678801408:12345-192.168.206.10@tcp:1:lhsmtool_posix.0 Request processed in 14090us (14754us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787485.322623:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:3.0:1787787485.334541:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787485.334998:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678801792 00000100:00100000:0.0:1787787485.335013:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678801792 00000100:00100000:0.0:1787787485.335100:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 53 00000100:00100000:0.0:1787787485.335113:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07070921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+14:14498:x1874630678801792:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787787485.335221:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b271a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.335246:0:15164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b271a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.335260:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b271a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.337827:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2721 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.337872:0:15164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c600/0xdeb1953cba4b26e9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3559c expref: 15 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.337883:0:15164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2721 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.337934:0:15164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c600/0xdeb1953cba4b26e9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3559c expref: 15 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.338650:0:15164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c600/0xdeb1953cba4b26e9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3559c expref: 15 pid: 15164 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787485.338670:0:15164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e48000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15164:1874630694508672:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787787485.338891:0:15164:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d070693e600 going to sleep for 11 seconds 00000100:00100000:1.0:1787787485.351770:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787485.351818:0:15164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e48000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15164:1874630694508672:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787787485.351875:0:15164:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2721 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787485.352574:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678801920 00000100:00100000:3.0:1787787485.352592:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678801920 00010000:00010000:3.0:1787787485.352643:0:14448:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c600/0xdeb1953cba4b26e9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3559c expref: 16 pid: 15164 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787485.352693:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:3.0:1787787485.352704:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d071b1df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0afca4d-e329-45bc-884c-b1ba8eafd358+16:2344:x1874630678801920:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787485.352722:0:14448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787485.352730:0:14448:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c600/0xdeb1953cba4b26e9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3559c expref: 16 pid: 15164 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787485.353195:0:14448:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c600/0xdeb1953cba4b26e9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3559c expref: 16 pid: 15164 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787485.353226:0:14448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c600/0xdeb1953cba4b26e9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c3559c expref: 16 pid: 15164 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787485.353247:0:14448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d07078d0100) 00010000:00010000:3.0:1787787485.353252:0:14448:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2721 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787485.353264:0:14448:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2721 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787485.353289:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2721 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787485.353314:0:14448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787485.353389:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d071b1df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0afca4d-e329-45bc-884c-b1ba8eafd358+15:2344:x1874630678801920:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 686us (1634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787485.353398:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 15 00010000:00010000:0.0:1787787485.354452:0:15164:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2721 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.354465:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2721 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787787485.354715:0:15164:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1787787485.357519:0:15164:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1787787485.357647:0:15164:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1787787485.357765:0:15164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0737e48000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15164:1874630694508800:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787787485.358002:0:15164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787485.358059:0:15164:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d07054cd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787485.358109:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694508800 00000100:00100000:1.0:1787787485.358121:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694508800 00000100:00100000:1.0:1787787485.358196:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787787485.358208:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15164:x1874630694508800:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787787485.358320:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15164:x1874630694508800:12345-0@lo:1000:mdt00_003.0 Request processed in 113us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787485.358329:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787787485.358541:0:15164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0737e48000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15164:1874630694508800:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1787787485.361701:0:15164:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1787787485.361831:0:15164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06010b6580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15164:1874630694508928:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787787485.361927:0:15164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787485.361972:0:15164:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0706aaaa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787787485.362088:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694508928 00000100:00100000:3.0:1787787485.362097:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694508928 00000100:00100000:3.0:1787787485.362155:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787787485.362164:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15164:x1874630694508928:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787787485.362374:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:15164:x1874630694508928:12345-0@lo:1000:mdt00_003.0 Request processed in 210us (446us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1787787485.362382:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787787485.364599:0:15164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06010b6580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15164:1874630694508928:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1787787485.364666:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2721 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.364853:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2721 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.364864:0:15164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2721 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.364871:0:15164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d060273c800 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787485.364876:0:15164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2721 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.364885:0:15164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2721 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.364904:0:15164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d07078d0100) 00010000:00010000:2.0:1787787485.364908:0:15164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787787485.364931:0:15164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2721 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.364939:0:15164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c800/0xdeb1953cba4b2721 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.364980:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a000/0xdeb1953cba4b2679 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.364988:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a000/0xdeb1953cba4b2679 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.364995:0:15164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a000/0xdeb1953cba4b2679 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.365000:0:15164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212a000 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787485.365003:0:15164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a000/0xdeb1953cba4b2679 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.365010:0:15164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a000/0xdeb1953cba4b2679 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.365019:0:15164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d071b71dc00) 00010000:00010000:2.0:1787787485.365021:0:15164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787787485.365029:0:15164:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39a00/0xdeb1953cba4b2680 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35580 expref: 18 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.365044:0:15164:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39a00/0xdeb1953cba4b2680 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35580 expref: 18 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.365054:0:15164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39a00/0xdeb1953cba4b2680 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35580 expref: 18 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.365149:0:15164:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd39a00/0xdeb1953cba4b2680 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x51f4fe6243c35580 expref: 18 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787485.365166:0:15164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06010b4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15164:1874630694509056:192.168.206.10@tcp:105: 00000100:00100000:2.0:1787787485.365317:0:15164:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0706aaa540 going to sleep for 11 seconds 00000100:00100000:2.0:1787787485.372011:0:15164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06010b4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15164:1874630694509056:192.168.206.10@tcp:105: 00010000:00010000:2.0:1787787485.372054:0:15164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a000/0xdeb1953cba4b2679 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.372068:0:15164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d072212a000/0xdeb1953cba4b2679 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14462 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.372111:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b2728 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.372128:0:15164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b2728 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.372142:0:15164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b2728 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.372154:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b2728 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787485.372309:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787485.372384:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678802048 00000100:00100000:3.0:1787787485.372394:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678802048 00000100:00100000:1.0:1787787485.372560:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:1.0:1787787485.372574:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073ffdc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+19:14497:x1874630678802048:12345-192.168.206.10@tcp:49:dd.0 00000100:00100000:1.0:1787787485.372742:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073ffdc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+19:14497:x1874630678802048:12345-192.168.206.10@tcp:49:dd.0 Request processed in 172us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787485.372751:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 10 00010000:00010000:2.0:1787787485.373051:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b2728 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.373058:0:15164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b2728 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.373081:0:15164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd38400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787485.373085:0:15164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b2728 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.373091:0:15164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b2728 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.373103:0:15164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d071b71dc00) 00010000:00010000:2.0:1787787485.373105:0:15164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787485.373108:0:15164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b2728 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.373112:0:15164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b2728 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.373121:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b271a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.373124:0:15164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b271a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.373128:0:15164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b271a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.373131:0:15164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d060273c400 already unused, calling callback (ffffffffc1ec14f0) 00010000:00010000:2.0:1787787485.373133:0:15164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b271a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.373136:0:15164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b271a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.373155:0:15164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d071b71dc00) 00010000:00010000:2.0:1787787485.373166:0:15164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787787485.373170:0:15164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b271a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.373177:0:15164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d060273c400/0xdeb1953cba4b271a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787485.373463:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07070921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+18:14498:x1874630678801792:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 38351us (38935us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787787485.373473:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 53 00000020:00080000:2.0:1787787485.373478:0:15164:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787787485.373829:0:14492:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787787485.373835:0:14492:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787787485.373879:0:14492:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787787485.373888:0:14492:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787787485.381826:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787485.384878:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678802304 00000100:00100000:3.0:1787787485.384900:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678802304 00000100:00100000:2.0:1787787485.385086:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:2.0:1787787485.385099:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+18:14498:x1874630678802304:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787787485.385984:0:14463:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787787485.386092:0:14463:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1787787485.386142:0:14463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b272f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.386162:0:14463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b272f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.386174:0:14463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b272f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.386183:0:14463:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b272f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.386190:0:14463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b272f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.386204:0:14463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b272f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.386224:0:14463:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787787485.386349:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+20:14498:x1874630678802304:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 1249us (4546us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1787787485.386360:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 11 00000020:00080000:2.0:1787787485.386365:0:14463:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787787485.386429:0:16574:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787485.386456:0:16574:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b272f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.386477:0:16574:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd38400 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:1.0:1787787485.386482:0:16574:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b272f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.386553:0:16574:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b272f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.386570:0:16574:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d07078d0100) 00010000:00010000:1.0:1787787485.386573:0:16574:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787787485.386578:0:16574:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b272f lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.386585:0:16574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d073fd38400/0xdeb1953cba4b272f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.386600:0:16574:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787485.386602:0:16574:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787485.386604:0:16574:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787485.591626:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787485.591679:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787787485.591715:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787485.592425:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678802560 00000100:00100000:2.0:1787787485.592471:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678802560 00000100:00100000:2.0:1787787485.592543:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678802688 00000100:00100000:2.0:1787787485.592547:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678802688 00000100:00100000:2.0:1787787485.592563:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678802816 00000100:00100000:2.0:1787787485.592566:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678802816 00000100:00100000:2.0:1787787485.592585:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:2.0:1787787485.592595:0:15148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d07070903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+9:2344:x1874630678802560:12345-192.168.206.10@tcp:4:dd.0 00002000:00010000:2.0:1787787485.592728:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a8f78dc, atime: 0x6a8f78db, ctime: 0x6a8f78dc, blocks: 0x1 00010000:00010000:2.0:1787787485.592741:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6872a14/0xdeb1953cba4b2736 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.592761:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=397s v=(0 0) 00010000:00010000:2.0:1787787485.592767:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787485.592775:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6872a14/0xdeb1953cba4b2736 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.592791:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6872a14/0xdeb1953cba4b2736 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787485.598536:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787787485.598639:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787485.598731:0:15147:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787787485.598800:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787485.598820:0:15147:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1787787485.598887:0:15149:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787787485.598909:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678802944 00000100:00100000:0.0:1787787485.598920:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678802944 00000100:00100000:1.0:1787787485.598999:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787485.599087:0:15149:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787787485.599098:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678803072 00000100:00100000:0.0:1787787485.599102:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678803072 00000100:00100000:1.0:1787787485.599110:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787485.599121:0:15149:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787787485.599132:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678803200 00000100:00100000:0.0:1787787485.599135:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678803200 00000100:00100000:0.0:1787787485.599149:0:15149:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787787485.599156:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678802432 00000100:00100000:0.0:1787787485.599158:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678802432 00000100:00100000:0.0:1787787485.599178:0:15149:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787787485.599185:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678803328 00000100:00100000:0.0:1787787485.599188:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678803328 00000100:00100000:2.0:1787787485.602352:0:16690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00100000:2.0:1787787485.602378:0:16690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707091a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+15:2344:x1874630678802688:12345-192.168.206.10@tcp:4:dd.0 00010000:00010000:2.0:1787787485.602432:0:16690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c60587f2/0xdeb1953cba4b273d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.602507:0:16690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787485.602512:0:16690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787485.602521:0:16690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c60587f2/0xdeb1953cba4b273d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.602540:0:16690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c60587f2/0xdeb1953cba4b273d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787485.757682:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787787485.759959:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:3.0:1787787485.759983:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00002000:00010000:1.0:1787787485.760162:0:15148:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:1.0:1787787485.760168:0:15148:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787787484 -> 1787787485 00002000:00010000:1.0:1787787485.760171:0:15148:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787787484 -> 1787787485 00002000:00010000:1.0:1787787485.760174:0:15148:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:1.0:1787787485.760191:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6872a14/0xdeb1953cba4b2736 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.760229:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6872a14/0xdeb1953cba4b2736 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.760239:0:15148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6872a14/0xdeb1953cba4b2736 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.760247:0:15148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39e00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:1.0:1787787485.760252:0:15148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6872a14/0xdeb1953cba4b2736 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.760264:0:15148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6872a14/0xdeb1953cba4b2736 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.760289:0:15148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6872a14/0xdeb1953cba4b2736 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.760298:0:15148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6872a14/0xdeb1953cba4b2736 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787485.760419:0:15148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d07070903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+17:2344:x1874630678802560:12345-192.168.206.10@tcp:4:dd.0 Request processed in 167818us (168799us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1787787485.760464:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:1.0:1787787485.760897:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:1.0:1787787485.760914:0:15148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707092d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+16:2344:x1874630678802816:12345-192.168.206.10@tcp:4:dd.0 00010000:00010000:1.0:1787787485.760957:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096aa4d16/0xdeb1953cba4b2744 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.760980:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787485.760996:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787485.761004:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096aa4d16/0xdeb1953cba4b2744 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787485.761019:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096aa4d16/0xdeb1953cba4b2744 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787787485.761864:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:3.0:1787787485.842953:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:3.0:1787787485.843031:0:16690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:3.0:1787787485.843058:0:16690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 4103 00010000:00010000:3.0:1787787485.843073:0:16690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c60587f2/0xdeb1953cba4b273d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787485.843086:0:16690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c60587f2/0xdeb1953cba4b273d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787485.843095:0:16690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c60587f2/0xdeb1953cba4b273d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787485.843102:0:16690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd39000 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787485.843106:0:16690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c60587f2/0xdeb1953cba4b273d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787485.843115:0:16690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c60587f2/0xdeb1953cba4b273d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787485.843136:0:16690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c60587f2/0xdeb1953cba4b273d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787485.843144:0:16690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c60587f2/0xdeb1953cba4b273d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787485.843662:0:16690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707091a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+14:2344:x1874630678802688:12345-192.168.206.10@tcp:4:dd.0 Request processed in 241289us (251976us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787787485.843690:0:16690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00100000:3.0:1787787485.843721:0:16690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 3 00000100:00100000:3.0:1787787485.843740:0:16690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe80780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+13:2344:x1874630678802944:12345-192.168.206.10@tcp:4:dd.0 00010000:00010000:3.0:1787787485.843771:0:16690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e22a19a/0xdeb1953cba4b274b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787485.843784:0:16690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787787485.843789:0:16690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787485.843795:0:16690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e22a19a/0xdeb1953cba4b274b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787485.843807:0:16690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e22a19a/0xdeb1953cba4b274b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787787485.996313:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:0.0:1787787485.997151:0:15148:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:0.0:1787787485.997159:0:15148:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:0.0:1787787485.997179:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096aa4d16/0xdeb1953cba4b2744 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.997194:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096aa4d16/0xdeb1953cba4b2744 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.997205:0:15148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096aa4d16/0xdeb1953cba4b2744 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.997243:0:15148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212b200 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:0.0:1787787485.997249:0:15148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096aa4d16/0xdeb1953cba4b2744 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.997260:0:15148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096aa4d16/0xdeb1953cba4b2744 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.997287:0:15148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096aa4d16/0xdeb1953cba4b2744 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.997296:0:15148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096aa4d16/0xdeb1953cba4b2744 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787485.997421:0:15148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707092d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+13:2344:x1874630678802816:12345-192.168.206.10@tcp:4:dd.0 Request processed in 236507us (405698us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1787787485.997432:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:0.0:1787787485.997523:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:0.0:1787787485.997538:0:15148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe80f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+12:2344:x1874630678803072:12345-192.168.206.10@tcp:4:dd.0 00010000:00010000:0.0:1787787485.997577:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf43ea78/0xdeb1953cba4b2752 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.997593:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787485.997598:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787485.997606:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf43ea78/0xdeb1953cba4b2752 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787485.997631:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf43ea78/0xdeb1953cba4b2752 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787486.077286:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06010b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:3293:1874630694509184:0@lo:400:kworker.0 00000100:00100000:2.0:1787787486.077386:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787486.077459:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06010b7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1874630694509696:0@lo:400:kworker.0 00000100:00100000:2.0:1787787486.077490:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787486.077525:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787787486.077531:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06010b70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694509312:0@lo:400:kworker.0 00000100:00100000:2.0:1787787486.077557:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787486.077573:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06010b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1874630694509824:0@lo:400:kworker.0 00000100:00100000:2.0:1787787486.077611:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787486.077654:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06010b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694509440:0@lo:400:kworker.0 00000100:00100000:2.0:1787787486.077692:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787486.077710:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06010b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694509952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787787486.077731:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787486.077762:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787787486.077767:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d06010b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1874630694509568:0@lo:400:kworker.0 00000100:00100000:2.0:1787787486.077788:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787486.078008:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694509184 00000100:00100000:2.0:1787787486.078017:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694509184 00000100:00100000:2.0:1787787486.078071:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787787486.078081:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073ff7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+19:3293:x1874630694509184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787486.078136:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073ff7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5502b2f0-3011-4fec-94b3-f0db12dfb3bb+19:3293:x1874630694509184:12345-0@lo:400:kworker.0 Request processed in 56us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787486.078144:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787787486.078179:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694509696 00000100:00100000:2.0:1787787486.078183:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694509696 00000100:00100000:2.0:1787787486.078217:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694509824 00000100:00100000:2.0:1787787486.078220:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694509824 00000100:00100000:2.0:1787787486.078232:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694509568 00000100:00100000:2.0:1787787486.078234:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694509568 00000100:00100000:2.0:1787787486.078246:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787787486.078251:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874630694509696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787486.078282:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874630694509696:12345-0@lo:400:kworker.0 Request processed in 30us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787486.078288:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787787486.078298:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787787486.078311:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874630694509824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787486.078336:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874630694509824:12345-0@lo:400:kworker.0 Request processed in 25us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787486.078342:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787787486.078352:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787787486.078357:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fa712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1874630694509568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787486.078383:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fa712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1874630694509568:12345-0@lo:400:kworker.0 Request processed in 26us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787486.078389:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787787486.078405:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694509312 00000100:00100000:2.0:1787787486.078407:0:15144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694509312 00000100:00100000:2.0:1787787486.078429:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694509440 00000100:00100000:2.0:1787787486.078431:0:15144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694509440 00000100:00100000:2.0:1787787486.078476:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787787486.078482:0:15144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d06010b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694509312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787486.078513:0:15144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d06010b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1874630694509312:12345-0@lo:400:kworker.0 Request processed in 30us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787486.078519:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787787486.078530:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787787486.078536:0:15144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fa72d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694509440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787486.078562:0:15144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fa72d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694509440:12345-0@lo:400:kworker.0 Request processed in 27us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787486.078568:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787787486.078596:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694509952 00000100:00100000:2.0:1787787486.078599:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694509952 00000100:00100000:2.0:1787787486.078628:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787787486.081862:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fa721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694509952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787787486.082045:0:15146:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787787486.082148:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fa721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874630694509952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3510us (4411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787486.082158:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787787486.082228:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787787486.082235:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787787486.084288:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06010b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1874630694509568:0@lo:400:kworker.0 00000100:00100000:2.0:1787787486.084325:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06010b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694509440:0@lo:400:kworker.0 00000100:00100000:2.0:1787787486.084348:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06010b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1874630694509952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787787486.084409:0:3293:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1787787486.084416:0:3293:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d0722250000, transno 8589934595 00000004:00080000:2.0:1787787486.084467:0:3293:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1787787486.084486:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06010b70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1874630694509312:0@lo:400:kworker.0 00000100:00100000:2.0:1787787486.084500:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06010b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1874630694509824:0@lo:400:kworker.0 00000100:00100000:2.0:1787787486.084513:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06010b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5502b2f0-3011-4fec-94b3-f0db12dfb3bb:3293:1874630694509184:0@lo:400:kworker.0 00000100:00100000:2.0:1787787486.084527:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d06010b7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1874630694509696:0@lo:400:kworker.0 00000100:00100000:0.0:1787787486.092339:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d07070930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694510080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787787486.092454:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787486.092835:0:15985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630694510080 00000100:00100000:3.0:1787787486.092856:0:15985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630694510080 00000100:00100000:3.0:1787787486.092912:0:15985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787787486.092922:0:15985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0737e48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694510080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787787486.092953:0:15985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 66387968 pending 3407872 free 3859808256 avail 3854565376 00000100:00100000:3.0:1787787486.094365:0:15985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0737e48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874630694510080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1434us (1920us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787486.094378:0:15985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787787486.099074:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d07070930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1874630694510080:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1787787486.120299:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:0.0:1787787486.123005:0:16690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:0.0:1787787486.123017:0:16690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 10247 00010000:00010000:0.0:1787787486.123034:0:16690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e22a19a/0xdeb1953cba4b274b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787486.123051:0:16690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e22a19a/0xdeb1953cba4b274b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787486.123060:0:16690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e22a19a/0xdeb1953cba4b274b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787486.123067:0:16690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0708770a00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:0.0:1787787486.123072:0:16690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e22a19a/0xdeb1953cba4b274b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787486.123082:0:16690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e22a19a/0xdeb1953cba4b274b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787486.123105:0:16690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e22a19a/0xdeb1953cba4b274b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787486.123135:0:16690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e22a19a/0xdeb1953cba4b274b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787486.123262:0:16690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe80780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+12:2344:x1874630678802944:12345-192.168.206.10@tcp:4:dd.0 Request processed in 279521us (524732us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787787486.123365:0:16690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 3 00000100:00100000:0.0:1787787486.123414:0:16690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:0.0:1787787486.123477:0:16690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fe83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+11:2344:x1874630678803200:12345-192.168.206.10@tcp:4:dd.0 00010000:00010000:0.0:1787787486.123520:0:16690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7bc8170/0xdeb1953cba4b2759 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787486.123534:0:16690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787486.123539:0:16690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787486.123546:0:16690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7bc8170/0xdeb1953cba4b2759 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787486.123561:0:16690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7bc8170/0xdeb1953cba4b2759 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787787486.123683:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1787787486.218683:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:1.0:1787787486.218789:0:15148:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00010000:00010000:1.0:1787787486.218805:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf43ea78/0xdeb1953cba4b2752 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787486.218824:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf43ea78/0xdeb1953cba4b2752 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787486.218832:0:15148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf43ea78/0xdeb1953cba4b2752 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787486.218851:0:15148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d060273d400 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:1.0:1787787486.218855:0:15148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf43ea78/0xdeb1953cba4b2752 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787486.218864:0:15148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf43ea78/0xdeb1953cba4b2752 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787486.218897:0:15148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf43ea78/0xdeb1953cba4b2752 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787486.218905:0:15148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf43ea78/0xdeb1953cba4b2752 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787486.219089:0:15148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe80f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+11:2344:x1874630678803072:12345-192.168.206.10@tcp:4:dd.0 Request processed in 221551us (620445us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1787787486.219099:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:1.0:1787787486.219131:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:1.0:1787787486.219144:0:15148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a08f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+10:2345:x1874630678802432:12345-192.168.206.10@tcp:4:dd.0 00010000:00010000:1.0:1787787486.219190:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b7f7570/0xdeb1953cba4b2760 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787486.219211:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787486.219216:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787486.219221:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b7f7570/0xdeb1953cba4b2760 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787486.219232:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b7f7570/0xdeb1953cba4b2760 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787787486.274379:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:2.0:1787787486.275265:0:16690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 14343 00010000:00010000:2.0:1787787486.275282:0:16690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7bc8170/0xdeb1953cba4b2759 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787486.275295:0:16690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7bc8170/0xdeb1953cba4b2759 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787486.275317:0:16690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7bc8170/0xdeb1953cba4b2759 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787486.275324:0:16690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d060273cc00 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:2.0:1787787486.275329:0:16690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7bc8170/0xdeb1953cba4b2759 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787486.275339:0:16690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7bc8170/0xdeb1953cba4b2759 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787486.275358:0:16690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7bc8170/0xdeb1953cba4b2759 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787486.275364:0:16690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7bc8170/0xdeb1953cba4b2759 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787486.275477:0:16690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fe83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+10:2344:x1874630678803200:12345-192.168.206.10@tcp:4:dd.0 Request processed in 152049us (676672us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1787787486.275498:0:16690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:2.0:1787787486.275541:0:16690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:2.0:1787787486.275969:0:16690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0707a083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+9:2344:x1874630678803328:12345-192.168.206.10@tcp:4:dd.0 00010000:00010000:2.0:1787787486.276014:0:16690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a99f1c6/0xdeb1953cba4b2767 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787486.276028:0:16690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787486.276038:0:16690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787486.276045:0:16690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a99f1c6/0xdeb1953cba4b2767 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787486.276057:0:16690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a99f1c6/0xdeb1953cba4b2767 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787787486.399928:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:3.0:1787787486.400054:0:15148:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00010000:00010000:3.0:1787787486.400073:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b7f7570/0xdeb1953cba4b2760 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787486.400106:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b7f7570/0xdeb1953cba4b2760 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787486.400115:0:15148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b7f7570/0xdeb1953cba4b2760 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787486.400123:0:15148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d072212a000 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:3.0:1787787486.400129:0:15148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b7f7570/0xdeb1953cba4b2760 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787486.400140:0:15148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b7f7570/0xdeb1953cba4b2760 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787486.400164:0:15148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b7f7570/0xdeb1953cba4b2760 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787486.400172:0:15148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b7f7570/0xdeb1953cba4b2760 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787486.400306:0:15148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a08f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e0afca4d-e329-45bc-884c-b1ba8eafd358+9:2345:x1874630678802432:12345-192.168.206.10@tcp:4:dd.0 Request processed in 181159us (801299us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1787787486.400318:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 6 00002000:00010000:2.0:1787787486.470745:0:16690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1787787486.470771:0:16690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a99f1c6/0xdeb1953cba4b2767 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787486.470787:0:16690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a99f1c6/0xdeb1953cba4b2767 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787486.470797:0:16690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a99f1c6/0xdeb1953cba4b2767 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787486.470805:0:16690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d073fd38400 already unused, calling callback (ffffffffc14b1420) 00010000:00010000:2.0:1787787486.470810:0:16690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a99f1c6/0xdeb1953cba4b2767 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787486.470820:0:16690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a99f1c6/0xdeb1953cba4b2767 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787486.470853:0:16690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a99f1c6/0xdeb1953cba4b2767 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787486.470862:0:16690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a99f1c6/0xdeb1953cba4b2767 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787787486.471163:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00000100:00100000:2.0:1787787486.471231:0:16690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0707a083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+5:2344:x1874630678803328:12345-192.168.206.10@tcp:4:dd.0 Request processed in 195668us (872108us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1787787486.471244:0:16690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 7 00010000:00010000:3.0:1787787486.780788:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787487.804656:0:16574:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787787488.480032:0:16729:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1787787488.829045:0:14450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787489.763368:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787489.763422:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787489.763488:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787489.763519:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787489.763539:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787489.763689:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678803584 00000100:00100000:0.0:1787787489.763702:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678803584 00000100:00100000:0.0:1787787489.763810:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 26 00000100:00100000:0.0:1787787489.763831:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fa73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+20:2344:x1874630678803584:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787787489.763933:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fa73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+20:2344:x1874630678803584:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 114us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787489.763942:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 26 00000100:00080000:0.0:1787787489.763970:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787489.764113:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678803456 00000100:00100000:0.0:1787787489.764117:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678803456 00000100:00100000:0.0:1787787489.764146:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 121 00000100:00100000:0.0:1787787489.764152:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073ff7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c13b403-cfe9-4f44-8f22-4e16a974f4be+13:2344:x1874630678803456:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787787489.764183:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073ff7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c13b403-cfe9-4f44-8f22-4e16a974f4be+13:2344:x1874630678803456:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 31us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787489.764190:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 121 00000100:00100000:2.0:1787787489.764484:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787787489.764512:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787787489.764552:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678803968 00000100:00100000:0.0:1787787489.764556:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678803968 00000100:00100000:0.0:1787787489.764593:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 27 00000100:00100000:0.0:1787787489.764601:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fa730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03f96fcc-4037-472b-8e81-03f071a5e665+6:2344:x1874630678803968:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787787489.764636:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fa730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03f96fcc-4037-472b-8e81-03f071a5e665+6:2344:x1874630678803968:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 35us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787489.764643:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 27 00000100:00080000:0.0:1787787489.764657:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787787489.773016:0:15989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678803840 00000100:00100000:1.0:1787787489.773036:0:15989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678803840 00000100:00100000:2.0:1787787489.773213:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678804096 00000100:00100000:2.0:1787787489.773221:0:15141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678804096 00000100:00100000:2.0:1787787489.773305:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678803712 00000100:00100000:2.0:1787787489.773309:0:15141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678803712 00000100:00100000:2.0:1787787489.773326:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630678804224 00000100:00100000:2.0:1787787489.773329:0:15141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630678804224 00000100:00100000:2.0:1787787489.773353:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:2.0:1787787489.773363:0:15141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fa71e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03f96fcc-4037-472b-8e81-03f071a5e665+5:2344:x1874630678804096:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787787489.773484:0:15141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fa71e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03f96fcc-4037-472b-8e81-03f071a5e665+5:2344:x1874630678804096:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 121us (9995us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787489.773493:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:2.0:1787787489.773513:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:2.0:1787787489.773520:0:15141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fa70f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+5:2344:x1874630678803712:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787787489.773547:0:15141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fa70f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e0afca4d-e329-45bc-884c-b1ba8eafd358+5:2344:x1874630678803712:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 28us (10007us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787489.773574:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:2.0:1787787489.773587:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:2.0:1787787489.773593:0:15141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fa71a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03f96fcc-4037-472b-8e81-03f071a5e665+5:2344:x1874630678804224:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787787489.773618:0:15141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fa71a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03f96fcc-4037-472b-8e81-03f071a5e665+5:2344:x1874630678804224:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 26us (9106us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787489.773625:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00080000:1.0:1787787489.773924:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787787489.773936:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787787489.774189:0:15989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:3.0:1787787489.774200:0:15989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d073fa70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+5:2344:x1874630678803840:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787787489.774261:0:15989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d073fa70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e0afca4d-e329-45bc-884c-b1ba8eafd358+5:2344:x1874630678803840:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 63us (10839us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787489.774268:0:15989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00080000:1.0:1787787489.774474:0:14456:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787787489.854952:0:14449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29226 lines, 29226 kept, 0 dropped, 0 bad.